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IBSTEACT . ' 

. , An evaluation study of scae work preparation (or 

pre- vocational educationi prograts in New South Sales and Queensland 
{Australia^ was conducted to accosplish* the following objectives: (1» 
to establish a general lethodological ^raaework for the continuing 
evaluation of Technical and Future Edi^pation (TAPE) pre- vocational 
programs; (2) to obtafin a* worthwhile assessaent of the effectiveness 
of a selected nuaber of work' prepar«tioh proqraaS currently offered; 
and (3) to identify Bajor probleas and factors which could guide the 
future developaent of work 'preparation prbgrass. In' developing a 
strategy for the evaluation of TAPE pre -vocational education 
prograas, a start was aade by exaainin^ the aain aspects of its 
rationale and the key f eatures of ^f our prograas in this field. The 
results of this exaaination 'enabled general, a pp roaches to educational 
evaluation to be incorporated in an evaluation fraaewcrk,''f or ' 
pre- vocational education, Subsequently, it was, possible', to ' identify 
data which needed to be collected about each elenent'of the framework 
ana to suggest instruseiits which aight be used for this purpose, 
Fi^nally, suggestions were aade of aeans by which data gathered about 
each eleaent in the fraaework could be used in further analyses., 
(This report is priaarily concerned with the first objective and, 
''contains a description of soae new developaents" in pre- vocational 
education, a discussion o'f the, rationale for programs in this 'area, 
and an outline of an evaluaticn approach'.) {BMV 
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JNTRODUCTION ' N 

Sackground to the snMy ^ i 

Technical and Further Educat^gp^ii^r^iimses a wide rang^ <^f progress ^oifeted 

in a range of institu^^ttsmd agencies. In e&sence -it is a>ivcemed with ' 

l>0^t sd«3oX 'education other than that provided at universities or the advanced 

^ ' « - 

education level in colleges of advanced education. T3ie activities which are 

seen as being the responsibility of TAffi* institutions ire: 

1 vocational training for a tra4e or other skills occupation either 
as iiiitial|prep<iratiOT, ^jwciaiization^^ updating existii^ 
knowledge, 

2 preparatory or br^kging courses prior to vocational training, 

3 Retraining for people returning to work or changing Jobs, ai^ , 

4 personal enrichment and other programs *not directly related to ' 
training for work. 

It is worth noting that whilst the en)hasis on vocaticmal education in 
Technical: and ^Further Education :|,s strong, it has been broadly defii^. The 
Report of the Australian Coaaittee on Technical and Further Education (1974) 
argued strongly against cpnceiving vocational education as a narrow fo^ of 
training concerned solely with the developaent of skills. It was stressed that 
narrowly qonceivM skill training was disadvantageous to the individual'^ both 
in terms of not acknowledging' personal developiaent , and in not creating the 
basic understanding necessary for continuing education. A shift in e^hasis 
was urged. The needs of individuals develop "their abilities was to be 
' accorded higher priority relative to the manpower' demands of industry. The 
change aay have been only one of emphasis^ but the recognition in t^e report 
of the iiJ5K5rtanK:e of balancing the needs of industry and individuals was a 
public acknowledgment of th^ broad role of vocational education. 

In addition to an ei^jhasis on ^roadly defined vocational education, 
a key characteristic of Technical and Further Education is its responsiveness 
to individual, coiaaunity. and industry needs. Sonetiraes this is emphasized 
in the claia that Technical and .Ftirther Education is wore clearly within the 
'se^i*', than the 'autonomous' tradition of post-secondary education 
(Coughlaa, 1977), While such a distinction is probably' more blurred than is 
currently recognized, its expression does emphasize a'point held by many in 
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Technical and Further Education*. By coB?)arison with a university, aiv 
institution of Technical *and Further Education places less anphasis on 
academic rigour ixi selection, on the advanceiaent of knowledge in established 
disciplines', ^and research.. Rather it esphasizes responsiveness to demand, 
teaching 'useful* skills, and open admission. 

As a coiisequence of these aspects of their rationale,, institutions ^ 
providing Technical and Further Education have been engaged in developing 
new coufses, and modifying existi^ig courses, in response to changing economic 
circumstances. Aaong several ii^ortant changes in economic circumstances 
over th^ past few ^eairs. have been: 

1 an increase in the general level of unemployment, 

■ 2 a mark^ increase in the level of youth unemployment, 

3 changes in the structure of, manufacturing and service industries, . and 

4^ ^ decline in the capacity ^of some industries to provide the components . 
of vocational education which they previeusly provided. 

V Given that Technical and Further Education is committed to being 
responsive to changing circumstances, the issue of program evaluation is one 
of great in^iortance . Decisions about the development" of new programs, the 
modification ^f existing programs , or even'^the discontinuance of sos^ programs 
need to l^e made on the basis of as much informatid% as possible. Evaluation 
has been defined as *the process of delineating,^ obtaining, and providing 
useful information for judging decision alternatives' (Stufflebeam et ai., 
1971:40). As such, a commitment to evaluaticjn is a necessary concomitant of 
a commitment to responsiveness. Evaluation should provide some guidance as • 
to whether new, or previously existing programs, are meeting the needs for 
which they were intended, and what modifications should be made to them. 

The Brief 

l^gainst this background the Technical and Further Education 'Commission approached 
the Australian Council for Educational Research with a request to undertake an 
evaluation study of some work preparation (or pre-vocational education) programs- 
There*were three objectives specified for the project. * 

1 

1 To establish a general methodological framework for the continuing « 

evaluation of TAFE programs designed to prepare people for working ^ 
life* This framework was to be capable of adaptation and modification 
as necessary to meet the needs of particular TAFK authorities for the 
future evaluation of their own programs in this area. 
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'2 Tq obtain a worthwhile assessment of the effectiven^sf of a selected 
nuaiber of work preparation programs curMntly offered in .Technical , 
and Further Education . ' 

^3 To identify major problems and factors which could guide the future 
development of work preparation program^ in Technical and Further 
Education. V * 

The brief indicated that a major purpose of the study was the establish-- 
ment of 'a sound aethodolpgical basis on which Technical and Further Education 
authorities -^themselves can assess the effectiveness of thei'^ current work 
preparation programs and plan the development of future prograias'. It was 
recognized that a-coisprehensive evaluation of current programs would be 
difficult because of the recent origins of the, programs-. For these reasons it 
was envisaged that the evaluation studies mentioned in ob'J^ctive two would be 
part of the developmentai work, associated with the n^thodology , 

Within the stateia*t of the first objective there was only a general 
indication of the types of program to which the luethodology should -be 
applicable: those which 'prepare young people for working life. An early 
stage in the project, described in Chapter Two, involved delineating a more \ 
precise definition of the type of program involved. 

There was an explicit indication with the stated objective of " three other 
points which have guided the project- , These were that t[ie evaluation TOtho- 
dology should be general, adaptable, and directed towards the requir amen ts^f 
^Jfechnical and Further Education Authorities. It is worth coilsidering these v 
three points in a little more detail. 

The programs be^ng considered in the present study ranged over dfverse 
occupational areas. In each there w^e goals which'Were general goalr and 
others which were specific to particular programs. Consequently the general 
framework for evaluation was developed in a way which drew attention to both 
types of goal. Some elen^nts of the ev>aluation* framework were generally 

applicable to all programs, while other elements were specific to particular- 

/ \ ■ 

^i^ograms . ' In the application of the evaluation methodology attention has been 
focussed on the general issues involved in the transition from school 4:o \ioTk 
rather than on specific occupational skills. By concentrating on these more 
general issues it was possible to make the best use- of the resources available, 
A specific skills oriented approach would have been o^ more limited use- 



• ' \, By ^kejiarating th« f»«ral froM the specific elemaits an ^valuation 
of p3r«-vo^tiaoal eaijcation-pMgarw^ we have"^att«a|)tf5d to indicate that such 



^ an ^prbach to eyaliiaticm can be^ adiiptab^e. Specific Mthods ts£ evaluation' 
suited to f articular objectives o'f different prograas can be ;^ncorporaj:e^^ » 

^ ^within a general framework*. In bri^f, prQlilsiOT^ for ad^ting the approach 
outlined in this repo^i: has fc^^ made by distinguishing S|^cific ^letoeits of 

: . particular pjre-v^cational educ^^tion prog^aas- frosL^enefal eleseats codson ta- 
all such programs . . » , ' ; ' * ' * / * f 

One problea in divelciping strategies for evaluation is offen'that /of 

defining the ^rlient groi?). In tfiis.pioiSct it w^; stated that' the evaliiatioi? 

strategy should be directed towards 7e<;hnical and Further Education authori-^ 

t:ies* -Oie iaportant amsequence of this directipn Was that it was passible 

'^to assM^e that resources would be available to those groups for statistical 

^ analyses of questionnaire returns and other data. Another ii^KJrtsast conse- 

• ' . ' ♦ 
quence j^ras that it could He assumed that those evaluating we^ not directly 

. involved in tSltching the prograa* ^spite this orientation s^ attest has 

been aade *to incorporate material which might also be of use 'fol-; ft valuation 

at college^level. Z^^*: '}^ 



The 
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This repoft is coursed of two voluaes* The first contains a description of ' 
some new developments in pre- vocational education, a discussion of tJ^e 
rationale for programs in this area, ^d an outline of an approach to their 
evaluation. The second contains the results of some trials of method^ in 
four selected 'pre-vocatipnal education programs. In brief, the first voliime 
is predominantly concerned with the first objective of the "study,, while the 
second is predominantly concerned with illustrative data arising fro© trials 
0$ the methods developed, ' ^ 

' s ' The_ programs studied in this project were not necessarily t^ical -of 
pre-vpcational education programs in Australia in 1978. They were drawn from 
ju$t two states: New South Wales and Queensland, . Moreover they have jlKen - 
selected a^ ' represattting iinportant developments in this field: siimia^d 
work environ^nts in college, polytechnitkl trade programs, the provision of 
extensive work experience, and the substitution of full-tiae for part-tis^ 
study. It was considered that a research project that concentrated on the 
isi^ues raised by these^developments w»uld be of odre value ^hai^ one which 
attested to encou^ass the full spaiyVum of pre-vocational education.- 
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* this report we have taken a broad view of the role ^.of pre-vocational 
education pro p:aas. Given a context of limited e^loyaent opportunities for . 
young people^ and changes in the d^aand for different types of skills such a 
perspective 'see»ed appropriate.- Rather than concentrate on the deveiopaent of 
particular skills for predefined occupations we have considered the role of 
these ^programs ih facilitating the transition of young people fro® schq^ to^ 
adult life,' Preparation for work has certainly been recognized as' an aspect 
of this transition relevant to the pjre^ent study, but we^he^ve also b^een * 
concerned with the'rple of pre-vocational education in the developaent of 
^studeftts^ who are. better able to participate in adult li^e. 

• * The Context 



•Pre-vocational education has emerged as an is^Jortant area of interest irf 

» #^ . ' , 

recent -times. The Comsittee of Inquiry into Education and Training, as a 

/ ' 

result of its exajnination of trade trailing reeomended 'a progressive 
^Xement to a substantial component o£ pre-employment education and train- 
ing' (Australia, 1979* (3) :20) , In support of such a shift in e^hasis the 
Coumittee argued that structural change had reduced the basis for effective 
training in some industries, that economic fluctuation had* caused reductions 
in the number of ^prentices , and that technological change had created. new 
desf^ds on trainj(|| systems. The comittee noted that there were differences'^ 
in opinion on the best methods of trade training. ^ It cited submissions which 
argued against any further shift towards ful J-time*^trade training other than 
initial training (Australia, 1979 (1) :305-506) , The argument^ against full- 
time training related to ther cost of' training and the need to ensure that 
training reflected actual work methods. With regard to this latter point, 
the Committee noted the observations of a previous study group which had 
reviewed full-tin« training methods in Europe* That group had expressed 
reservations about the lack of practical workshop experience in those courses 
(Australia, 1969). As a consequence the Coimaittee favoured a' mixei system 
involving a substantial component of pre-en^^loyment education as part of the 
method of trade training. However it was suggested that the increase in pre- 
en^loyment training should be gradual and in only a few trades at fijst- 

According to this view the evaluation of pre-vocational education would 
play an important role in the evolution of new structures of vocational 
training. In this report some approaches to such evaluation studies have 
been suggested. The approaches suggested have been concerned with educational 



aspects of programs of pre-vocational eduj^ion. Other isportapt aspects 
of the provision of such prograais were beyond the scope of the study,- 

It is iB5)02rtsnt to vrecognize that the main thrust bf this report is 
the developsaeiit of a general framework for evaluation rathfer than th« 

prescription of a detailed procedure* In anv evaluation study of a prbgrain 

J*- . 

on pre-vpbational education it will still be important to identify the 
iB5porttiiijt;.-evaluation question iaost relevant to thaf particular program "and 
deteryise^ t^ie most appropriate procedures for gathering evidejjce., the 
detained '^rocsdures tried as part of the present study constitute only one 
of a number of 'possible ways in which the general framework might be used. 
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CHAPtER 2 ' 
PRE-V(K:ATI0KAL EMJiiATI ' : ITS RATIONALE 



Types of Prograa 

' ^ •• - *■ ■ . ' , ,'' ' 

A great iany'of the. educational prograas offered in Te'chnicsl and Farther 

Education institutions could -\fe ccsisideted to involve work prepsra^on. 

Indeed- an . ii^rjan^ coipotiant of »any courseis in other ^foi»s of po^t- 

secondary educaticsi is preparation for work. Thc^ present project^'has be^n 

deliberately confined in its -scope twoVays, Firstly, it has^ljeen c^fined 

to programs conducted in institutions of Technical and Further 5iiucatic 

Secondly, and additionally, only a particular group of prograjj^/has be 

considered** This grot^ has*been called pre-voca'tional education prograas, 

' ■ ■ / ■ J I 

The term 'pre- vocational* hi^ been used in a g&neric sense to ji^clud^ a wide 

w range of prograas rather thin one specific course of study. 

The essential eleiaent of all these educational programs /being considered 
is that they provide a cou^e of full-time training for youM people prior to 
^ coaaoencing work. In general pre-vocationsl programs admit /students after 

compulsory schooling finishes at about Year 10. Thus they [begin it the basic 
^ post -secondary level Equivalent in age to the first stage ,of an apprentiofeship 
Programs which fit these general criteria vary in vocational sp^ificity, the 
extent to which they are planned to lead to further training, aiid the time ' 
taken to coi:f>lete the course. v . 

Th^re are four important groups of educational progi^ams in Technical and 
' - Further Education which can be classed as pre-vocational in *the sense 
described above. 

1 Pre-apprenticeship programs which are intended to-tlead directly to an 
apprenticeship in a particular trade. Conpletion of such a course may 
involve ^me reduction in tke duration of an apprenticeship and the 
educational requirements of an apprenticeship, 

2. Full-tiffio courses intended to provide work preparation in occupational 
areas which have not /keen involved in the apprenticeship system. One 
such area is that of office or clerical work. 

- 3 Polytpchnical courses designed to provide an introduction to a range 

of trj^des with some specialization later in the course. These courses 
may be intended to lead to an apprenticeship but might not necessarily 
involve a reduction in the term of the apprenticeship. 
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Coifrses of. full-tiie studV intended to tead to a cosi)ination,of work 
and further part-tiaie study though not subject ta the apprenticeship 
systea. . , 

In 19!^ the^duration of most of the programs considered to be pre- 



vocational vas one year."* However there w^re several specific pre -apprentice - 
'ship courses which were only 14 weeks long (e.g. the pre-apprenticeship Sign- 
writing course in Queensland) while others extended over 54 weeks (e.g. one 
form of the Carpentry and Joinery course xin New South Wales). * 

^ The Rack ground to Br e-Vocational Education: An Overview ^ 

Recently there* has beeh increased attentijOn* given t^o^ucational programs 
designed to facilitate the transition of yoiiig pe<^e>^frga 'school tp work.- ^ 
Manifestations of this concern can be found fn ^e variety of work experience 
programs offered in secondary schools (Blakers , 1978:349-406), linked courses 
(Blakers, 1978:416-432; Gatts* 1978) , and in the general ^n»ve to include aore 
^vocationally oriented subjects in the general secondary curriculum. Pre- 
vocational education programs in Technical and Further Educatioti institutions 
have also been .seen as a means of assisting young people move from school to 
work (TAFEC, ^977:125). Central to^this view of the role of pre-vocational 
education is the belief Jhat the development of general and specific vocational 
skills through these courses^rO^H facilitate the transition from school to work. 

Concern with the transition from school 'to work is not the only factor 
which has aroused interest in pre-vocational education- Three other factors 
appear to be involved in the development of these programs: 

1 >»eeting the changing manpower demands of industry, 

2 overcoming difficulties in the apprenticeship system, and 

3 providing a suitable curriculum for the greater diversity of abilities 
and interests that characterize pupils^ now remaining at school to senior 
levels. 

These thr^e factors can ht linked to the aims of prc-apprenticeship courses 5ub- 
mitted to the Committee of Inquiry into Education and Training by the New South 
Wales Department of Technical and Further Education (Australia, 1979 (1): 
29S-299) . That subssission classified the aims of pre-*appr^ticeship as primary 
and secondary. -Pjrimary aims concerned the transition f^om school to work 
through the development of vocational skills which matched the needs of industry. 
Secondary aims concerned the personal development of individuals as members of 
society. Thus the^e primary and secondary aims of pre-apprenticeship courses 

9^- % >y ■ A 
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correspond to the major factors which appear to be important in arguments 
for the developsMt^r pre-vocational education in general, ^ 

The iipo^tance of each of these factors differs for different types of 
progrfSa,, and- varies over tia^ as econoaic circumstances change. However, 
all. four are given soae recognition in the stated rationale for most pre- 
vocatidnal programs. Issues related to the. role of pre-vdcati^nal education 
.in the transition from school to work will be considered in ^ater detail 
later in this chapter. Pri^or to discussing those issues it is worth 
considering the other three factors often inqludfed in^ the rationale for pre- 
vocational education. 



Manpower Demands 

* *■ 

The Technical and Fui;ther Education Commission '(1977:125) J\as suggested*" that 
two types of alleged isanpower demands appear to have prompted an interest in 
full-titae pre-vocational courses. The first was*, the general demand ^or 
skilled labour. The second was the episodic demand for skilled manffi)wer as 
industry emerges from a recession. * 

General demand ) 



m 
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Since 1971 there appear to have been two distinct periods of chang 
employment in Australia. According to the Department of Employment 
Industrial Relations (1978), up to June 1974 there was a strong dec 
labour. By contrast in the subsequent four years to mid-1978, thei 
weakening of the labour market. The decline was most marked in mai 
industry where employment fell by 206, pOO since March 1974, and biK^ld^ng 
v.here employment fell by 60, 200* since a peak in May 1975, Only infche 
tertiary sector which is mainly concerned with the provision of services, 
has there been sustained growth in employment since 1971, Since jftne 1974 
an additional 162,000 were employed in the tertiary Sector of the jCbrkf orce. 
Moreover, of the industries other than those in the tertiary sectir, surveyed 
by the Department of Employrnent and Industria\ Relations, an increased demand 
for labour was forecast only in coal mining arid electricity and |as- 

The analysis cited above is concerned k4th the general empK)yment demand 
and does not necessarily indicate the position of skilled tradesmen, tt has 
been argued by some (National Training Council, 1977a)' that evfin when there 
is high unemployment there ipay still be labour shortages in ceflrtain skilled 
occupations such as the metal and electrical trades. The Tcjcftnical and Further 
Education Commission submitted to the Committee of Inquiry ijSto Education and 
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Training as part of an argment for the develQpwpt of new« and expansion of, 
existing forms of skill training^^ the view that skill shortages existed in 
SOM areis. 

* «5 

At present » despitOTfhe depressed state^of.the 6conosy', there artf still 
'labour shortages in certain skill areas ^ in the metal trades for 
example. Current^ shortages t>f skilled people, and trends >n migration . 
mentioned above, and demographic trends and- indicfitiijg an aging of the ' 
population combine to indicate ihe need for' urgent measures to. avert a 
skill shortage. (TAFEC, 1977:149) ^ , ' « ' 

{ 

'Thm N&tional Training Coi^il (1977b) iidentified three sources of skilled 

manpower: migration, upgrading and»apprenticesh,ip training. It was claimed 

that migration had Ceased to be^ a' ma^or source of^ski^led @uuipower l>oth ^ ^ 

• ' . ' " ~% 

because the general level of migration has been reduc'ed and because the pro- 
tt * ' , * 

portion of skilled workers amng migrants has 4eclined* In support of this 
claim a co4pari^on was made between the proportion of skilled mrkers in the 
Australian population (9.3 per cent of the workforce in 1977) asui the ' 
declining percentage of skilled workers among migrants (10.6 per cent between 
1961 and 1965^to 9,3 percent during the period 1971 to 1975). 

Jnformally upgraded tradesmen ^were recognized by the N^itional Training 
Coimcil as a significant but unqiiantif iable component of the skilled work- » 
force. A survey in .1969 suggested that up to 26 per cent of fitters and 
turners and machinists, and 14 per cent of motor mechanics and panel besfters 
were in this category (National Training Council , 1977b) . . These results 
were broadly consistent with a more recent survey conducted by the Australian 
Bureau of Statistics (1977) which estimated that 86 per cent of people working 
as tradesmen were qualified, although there were differences between indus- 
tries^ states and between private and public employment. More unqualified 
tradesmen* were employed in private than public enterprises. Small firms 
were also more likely to em^loy^ unqualified tradesmen. *A significant dis- 
advantage of this system for the individual is that the upgrading is not 
necessarily transportable on changing job^. This is because the upgrading 
may be for very specific work. , It is also noteworthy that upgrading is more 
prevalent in periods of high employmerlt : a point which suggests that existing 
training schemers might be inadequate in times of buoyant economic activity. 
In a limited number of trades upgrading may be formally recognized under the 
Tradesman's Rights Regulation Act, but the number of people who gain trades- 
mens certificates in this way is small. Apart from migrants, the number'of 
certificates issued is about 1,400 each year (National Training Council, 
1977b). 
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* On these grouiuis the Naticm&l Training Council argued that by far 'the 
major source oSf ^skilled trade^en ds the apprpntieeship systoi. The nature"^ 
of this system will be discussed in the next section. At this* stage 
' the discussion is directed only to statraents aade about the system as a - 
source of skilled tradesmen. ^ 

The National Training CouncJ.1 (ia77b:3) estimated that the intake of 
new appifijntices had average abojut ^,000 each year since 1973/7<f. Of , this ^ 
About 20 ger cent of apprentices withdraw fros training during their/period 
of., apprenticeship. Consequently it estimated the net output of the system 

*at^about 30,000 each year. Over the, ten-year period froi 196,7/68, to 1976/77 
it would appear that , the annuall intake of new apprentices has gr^c'pw^ from 
aboiit 2S,000 to about 39,000 (AUstraUan Apprenticeship Advisory Committee, 
l^Tpf jfore recent data contained in the report of the CommikteeVo€ Ijviuiry 

^'^m<j^,jgd*^ (Australia, 1979) EK>ted further irfcr^ses in the 

numbers of new apprentices in 1977/78. 

Estimates of the requirements for skilled tradesmen appear to be 
difficult to mai^e because^they depend so much on assmptions aboiif factors 
which are difficult to estimate. "Such factors include. the level of activity ^ 
in industry, the rate of retirement of skilled tradesmen, the impact of 
technological change, and changes in productivity. The question of the 
extent to which the apprenticeship system appears likely to supply . sufficient 
new tradesmen is further complicated by the nature of statistics about that 
system. The Committee of Inquiry into Education and Training (Australia, 1979) 
observed that some of the statistics concerning the numbers^^f apprentices 
in training had uncertain bases, 

^ The National Training Council (1977b, 1978b3 has argued that the 
existing apprenticeship system would *nbt produce sdifficient skilled trades- 
men to completely replace estimated annual losses. That argument assumed 
an annual loss of four per cent fro® the existing 'skilled workforce'. A 
small difference in the assumed rate of loss would affect the conclusions 
quite substantrially. Moreover, in the estimates laade by the National ^ 
Training Council there existed soiae uncertainty about the pool from which 
•losses were calculated. The skiljed labour force is somewhat greater than 
the number of qualified tradesmen and this creates a problem in estimating 
the number of new ti;adesmen required. The Industrial Training Commission of 
Victoria (1977) has c^t»wn attention to thf need to examine the age distribu- 
tion of the skilled workforce. Oi^ the ba-^is that the rate of retirement was 
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iikely to incr^se, that l>ody Mgiii^d that there wa^^a need to increase the 
^uibej of t^adesaen in 'training « 

Analyses ^conducted for th|P Coatfitrtee of Inquiry into Education and 
TraiMng CKinnaird^979) were concemeji wifh the issue of whether there 
werc^le^^S®^ of skille4 labour at thfe present ti«e. Based bfi survjeys 
conducted by the Department -of Espjoysent and Industrial Relations it was 
conclt^ed thKt there wak* not* an overall shortage of tradesoen in^Australia 
in 1977 ^Kinnairs, 1979:474} • In fact there appeared to be' rather more 

- un^loy^ tradesmen than unfilled vacancies,. Thi^ report suggested that 
' thMeVergf Structural imbalances ,irf the labouf market rather thati any 

/ generil shortage of skilled labour. Hence it' would -appeir that the aggregUte 
numbers of tradesmen and ^vUcancies for tradesmen appe^ar ta deny the claims 
of shortage. However there may be specific shortages in particular occupa- 
tions, locations or even skilly areas within trades (Department of Employment 
and Industrial Relations ^ 1978), even though these would appeiar to be few in 
number. Part of the reason for differences in the viewpoints outlined above 
may lie in the pature of the estimates being made. The estiJ»ktes produced by 
the National Training -Ge«acil (1977a} indicate impending rather than actual 
shortages. Present vacancies could be filled by unqualified -tradesmen.. In 
fact actual vacancies may not eventuate even though skilled tradesmen retire. 
National Training Council estimates assume no reduction in the demand for 
skilled tridesmen. - If the extent of automation in industry has increased 
then the rate of production of new tradesmen need not be equal to the rate 
of retirement of existing personnel. The recent Crawford (1979) report on 
Wnufacturing industry in Australia has explored the effects of automation 
in more detail than is possible in the present report. It argued for more 
extensive retraining schemes to assist people t^adjust to Ranges in the 
nature' of work available. 

In spite of the uncertain ^ature of available employment there does not 
appear to be any shortage of willing applicants for apprenticeshi'ps.^ Macka^. 
(l^^a, 1977b) found in an urban region of Melbourne, and in a rural city, 
a number of potential apprentices who returned to school, or enrolled in 
other courses, simply because they could not find employment as apprentices. 
On a national basis it is acknowledged that there is an excess of applicants 
over apprenticeship vacancies (National Training Council ,1977) . In addition 
^**^here are probably many potential apprentices who at present are ineligible 
" because they are older than 19 years. Where this age restriction does not 
apply, in the Australian Capital Territory, one in eight of the apprentice 
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intake is ov*t 19. Given that there is no shortage of applicants, the 
li«i ting factor vwuld appear to be the capacity of the apprenticeship syste®, 
particularly the capacity *o£ industry to provide on-the-job training. A^ng 
the several suggestions for resolving this iapasse are proposals for co«pl0K- 
*• entary variations of appMnticeship which involve providing the first yea;: of 
the program on a full -time basis in a college. 

'The National Training Council C^QTTb) has advocated one such scheme which 
could rediice the demand on industry for a givea output of tradesTOn. Under 
that proposal one third of an intake of ^prentices would undertake one year 
of full-tiae training followed by two ye^ars 4n industry. The remaining, two 
thirds of an intake would serve a convientional four year 'apprenticeship.' The 
output from each scheme would be the same but the former would involve about 
17 per*cent fewer places in industry at an)» time* If all of an intake followed 
the new program only half as many places in industry would be occupied ais in a 
conventional apprenticeship. Clearly the ratio of output to demand on 
training^places in industry is higher undar the revised scheme. However, it 
needs to W hoted that the total time of training is reduced from four to 
three years as a result of a more intensive full-time first year. It can be 
argued that in circumventing the restrictions on the intake of apprentices 
by the limited^ capacity of industry, a cost has been shifted from the private 
to the public sector. This would, arise since students would be doihg at 
least the same amount of off-the-job training as previously, hut there may 
be a need for some additional facilities as a result of the larger intake 
and there would be a need to provide more practical training in the first 
year* ^ . 

^ Such^a proposal is nqit ,very different from^he pre-apprent iceship courses 
in New South Wales and elsewhere in which students study full-time for one 
year and subsequently obtain a reduction in the term of their ap^enticeship, 
- Fre-apprenticeship courses have been included in the category py4- vocational 
for the purpose of this report. Accelerated Apprenticeship Ti^ining (Griffin, 
1978) in Victoria compresses the 'off-the-job* training into fthe early years 
of* in apprenticeship bul does not reduce the total time of tire indenture. 
More importantly pre-apprent iceship courses are undertaken t^fore securing an 
apprenticeship while Accelerated Apprenticeship Training is a variation in 
training arrangements after an apprenticeship has been secured- For these 
reasons Accelerated Apprenticeship has not be^en considered pre-vocational , 
A_ crucial issue in the role of pre-apprenticeship programs, as part of a 
complementary strategy to increase the capacity of the apprenticeship system 
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is that of the •transition £ro» prc-apprenticeship to apprenticeship'. It is 
ilpoctaiit toj^u whether a high proportion of those who curplete such 
prograas ^xDsequently gain apprenticeships. If few graduates are able to 
couplet© th^ir traiaiiig the capacity of the*systM would Mt^have been 
increased. In bri«$f , the issue is whether thp ^^^tation has been reduced 
or aerely shifted to another ixsint. 

A more radical, approach which has been advanced by soi^ie'has been to ' 

provide a coap]^eteiy full-^time program of* training in the skilled trades. 

Such a proposal^ would enable the -output of tradesmen to be based *on(th^ 

estimated needs of Indusftppy rath%r than limited by the capacity of industry^ 

to provide training places. It would involve a substantial shift in the 

cost of training fro® the private to : the public sector, as training woulct 

be financed in the same way a^ for other forms of post -secondary education. 

The Australian CoBsaittee on Technical and Further Education alluded to such 

a scheme: - ' 
t 

In the' lig^t of population and labour force trends and the tendency 
for youtJ\f to gain laore education, the gap between the supply of • 
apprentices and the demand for tradqsu^n is unlikely to be closed by 
the number of 15-19-year-olds entering apprenticeship unless changes 
to the system occur ©ore rapidly to suit present social and industrial 
circiimstances. One of the principal changes should be to implement 
Conclusion (44), whereby youths would be subsidised as fStudents, if 
they are prepared to study at a technical college full time in the 
trades areas for a period; |his period would be credited as part of 
the apprenticeship, should they subsequently enter the trades. This 
would require a conscious policy change. The fiction of the present 
apprentice-in- industry concept is that apprenticeship training is 
essei^ially on the job tr4ining, supplanented by attendance at school. 
The actuality, however, is\a m^xed system concept in which schooling 
and job experience are a pa'rtnership, that is, are complementary. The 
mixed system shbuld make provision for an introductory per'iod of 
education and training of| the job for the leAming of the basic 
elements of trades and proper work methods and be followed by periods 
of training and experience iil industry. ^ Changes may be necessary in 
industrial law to bring about the maxiuaim flexibility in apprentice 
training arrangements. (ACOTAFE, 1974: 1) . 

Conclusion (44) stated: 
* 

The organization of technical college pourses Should be revised to 
include a full time optioVi for students who in its absence enter the 
labour force prematurely and most qf whom are not attracted to the 
tertiary courses available on a full time basis at other Institutions. 
There is no logical reason why the cojminity should not subsidise they 
vocational education, of persons wishing to study for skilled or middle 
level occupations at^a technical college to the same extent as applies 
* to persons seeking a degree or diploma at a university or college of 
advanced education (ACOTAFE, 1974:x/vi) 
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Full -time pre-vocationsl education programs were thu^een as precursors to 
* the development of iK>re far reaching full-tiae training for tradesTOn. As 
such continuing evaluation of these programs is ia5)ortant as a guide for 
future policy. ^ ' 

^ An additional aspect of thg training of skilled^labour is ^at not all 

occiq)ational areas are served by. the apprenticeship system. Many areas' of 
skill re]^ for skilled labour on variety of formal and informal systems. 
In other areas technological change h^ placed new demands on training 
Sfystems^ New types of occupations have arisen and the nature of the work ,, 
performed iQ, existing occupations has altere4- Education arid training in 

some modem skills is not necessarily be^t achieved thropgh apprenticeship. 

ii 

It is unclear how effective existing systems are in trainiiig slcilled 
workers at the present time. However, the Organization for ^onc^dc Co- 
Operation and Development (1976) considered that there were ina^quate 
opportianities for young people to gain practical training outsicfe the 
apprenticeship system. Thfs was described as constituting a major problem 
for the supply of skilled labour in certain areas. 

Episodic demand . 

The second ty^e of iLniK)wer dmand cited by TAFEC (1977:124) in support of 
the development of pre-vocational education is episodic demand. This tefers 
to the demand for additional skilled manpower as the economy emerges fr«ss a 
recession. It has already been noted that the key factor governing the output 
of skilled tradesmen through apprenticeship tbe capacity of industry to 
employ apprentices. In fact the capacity of an industry to ei^loy apprentices 
depends largely on (the level of activity in that sector of the economy. Given 
a depressed level of activity, as at present, the capacity of industry to train 
apiprentices is reduced. Under these circumstances when there is potential for 
aiTj/ expansion of activity in an industry, perhaps arising from changes, in 
economic policy, the response of the industry will be limited by a lack of 
skilled workers. In turn this inability to respond will prevent any economic 
stimulus having a general or immediate limpact. The problem has been given 
prominence by the National Training Council C1978a, '1978b) who have argued 
that such shortages would lead to ^production bottlenecks and neW inflationary 
^ pressures*. As the Technical and Further Education Comission (1977:124) 

stated, no changes in the apprenticeship system itself will resolve this 
problem. 

The fact that the extent of training is tied to the level of economic 
activity is compounded by the duration of the term of indenture,* In general, 
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m:^ intake of apprentices will take fcHir years to becoM qualified as skilled 
i tradesmen. As a consequence any attempt to respond to changed circuastances 

will not be rapid. Thq^e yho argue that the apprenticeship syst^ balances 
* the supply and deaazui for skilled labour igiK)re.the lag which is inherent in 

the system. At present there appears to exist a nexus between the provision 

of training and the level of economic activity* 

Pj^e-vocational education programs have beeti seen by the Techflfical and . 
Fxurther Education Coanissicm (1977:125) having the"{K>teritial to reduce 
these problems. It is argue^^tiUt as a c«»ple«nent to'yDon\j^ntional 
apprenticeship such courses would buffer thfe "effects of variations in ^ 
business activity. Pre-^pprenticeship courses provide part of the normal 
training on a full-time basis so that the xuimber of places available is not 
dependent on industry. The available places can be increased in advance of 
a predicted economic recovery. Of course the later parts of the training 
progra^ would be still dependent on iiuiustrial training though the time 
lag between increased intakes and increased numbers of trained workers woi^l^ 
be rather shorter. ' ' 

The problem of co-ordinating the output from j^re^-apprenticeship with^ 
the' availability of apprenti>i|^Htt^aces could pe approached in three ways. 
One would be to attemjit a carefl^Trediction of needs and control entry to 
pre-apprenticeship courses using manpower planning principles. Unfortunately 
it does not seem that manpower planning is sufficiently accurate to enable 
this to be attempted with much confidence. A second approach would be to 
allow the numbej*s in pre --apprenticeship courses to exceed the predicted 
apprenticeship places, and perhaps even to be based on social demand. 
Selection of apprentices would probably be more reliable than if it were 
done direct from school, and students might be^ bei'ter informed about the 
nature of the trade. Those entering pre-apprenticeship would need to be 
made aware of the availability or unavailabilit^^of apprenticeships. The 
Technical and Further^^Mucation Commission (.19^:125) considers such an 
approach could be socially justified if the pre-apprenticeship provided 
young people with a better opportunity to secure employment apart from 
apprenticeship. Such an approach could also be further justified if the 
courses were valuable for the personal development of the individual. A 
third approach would be to extend the pre-vocational courses ,so as to provide 
a ccHirse of full-time trade training as a general basis for employment in 
a trade so that training was independent of the level of activity in an 
industry. The rani fi cat ions of this alternative in terms of cost, practical 
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training and social- develofwnt arle very broad and beyond the scope of this 

teport. At this stage it can be noted that the Techftical and Further ' 

Education Council (1977 2125) indicated its support for a careful aonitoring 

of pushers, but allowing sc^ excess, in pre-apprenticeship courses. 

^ / ' * ' ^ • ^ ' 

Any 'consideration of th^ potential role of pre-voc^tienal education in 

meeting jaanpowet deaiinds depen4s on assumptions Aade abput tiwse demands. / 

^"The extertt of skill shortages in in^u^try is uncertain. However, if there ' 

are shortages it.seea^ that -ejfist 4^ aetKbds ©f training^ sTci lied workers , . . 

are unlikely t&.pvercoae ^theia, I*ull-tiBfe trp^ining prograas are suppdrtied,, •* 

by their advocates on the basis*'that they increase both the capacity, and 

the responsiveness of the training syst^. They are also seen to*^provide 

traiftlUg in arto^ of skills which ar^.^-TMt served by the apprenticeship 

systea. ' . 

w - » 

■ - ' ' " . ■■■^ . ^ 

fhe Apprenticeship Systan 

In the discussion of the deaand fox* skilled manpower in Australia, the 
apprenticeship system was mentioned as the major- soyrce of skilled trades- 

• men. During that discussion, attention was focused on the capacity of the 
apprenticeship system to train the ntEmber of skilled tradesmen required by 
industry. Sqme opinions suggested that the future output from the apprentitcr 

5. ship system would be insufficient even if levels of production remained static. 
In the event of greater demand for goods and services, it was argued that the 
apprenticeship system would riot be able to respond by increasing its output 
quickly. There remain other aspects of the Apprenticeship ^g^^stem which are ' 
important to any consideration of the development of pre-vocatiqnal education. 

■ ^ ■'• ■ 

The system 

<^ *' 
Apprenticeship in Australia at ^JyeseBt involves industry , and technical colleges 

in a co-operative training venture. Klormally/ the duration of an apprenticeship 

is four years during which the apprentice works for an employer and attends i 

technical college for part of the time. The apprentice and the employer enter 

a contract, or an indenture, binding the apprentice to the employer for a 

prescribed period of time.^ In return the employer undertakes to teach the 

apprentice the trade or craft. State apprepticeship authorities are responsible 

for ^approving those employers who may employ apprentices and for ensuring that 

the conditions of the apprenticeship are fulfilled, the Content and structure 

of the trade courses offered are the responsibility of Technical and Further 

\ Education Authorities who normally collaborate with trade advisory committees 
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of the apprenticeship author! t^j^ Thoixgh there is som variation between trades 
and between states a normal four year apprenticeship would involve an apprentice 
in about 800 hours attendance at colle^se. Provisions for college atte^dance^ 
also vary between trades and states but coimoonly involve either 'day release* 
or 'block ijelease' , A typical day release aj^angejaent would involve a student 
in eight hours attendance (in one day) ^t^llege each week, for 36 weeks over 
the first three years of the appren^^teship. ^ A typical 'block release' program 
would involve attendance at coll^ege^ for seven iJeeks (40 hours each week) , in 
each year, over the first three years of the course. Block release prograias 
arc mbre prevalent in states such as Queensland where transport to day release 
training would prove difficult. It should be eji5)hasized that this is a much 
sAn^ilified picture of the apprenticeship system in Australia. In fact the 
system is extremely complex as a consequence of the variety of special require^ 
ments of different occupations, the plethora of responsible authorities, and. 



the relations between coraonwealth and state^ industrial jwardsr^ A uwre 
detailed description is contained in the recently published accbtSnt of the 
essential features of Australian ^prenticeship systems (Department of 
Eiaploynsent and Industrial Relations, 1977), 

Griffin (1978) has described the way in which the present system of 
apprenticeship training has evolved. It originated in the extended 'on the job* 
training jfcbvided for apprentices by master craftsmen lasting up to nine years. 
This usually involved the informal transmission of knowledge and skills through 
a close working relationship. Usually the craftsman provided food and board, 
together with a^small amoujjt of money for the apprentices under his charge. 
During the. nineteenth centuryvas production became m)re industrialized the 
training process was restricted' to observation, practice, and advice at 
work (White, 1971). Griffin characterized this shift as being from a personal 
to a professional bond. He noted that this shift finds its ultimate 
expression 'in the full-time training systems of some European countries. 

The incorporation of a component of technical schooling was a still more , 
recent development. -Griffin (1978) observed thal^^h^j role of technical ' 
-echooiing has been enlarged from its original purpose of proviSing instruction 

trade theory. Training in practical skills was provided at technical 
schools because employers had trouble providing suitable practical training 
on the job. Now employers provide mainly opportunities for practice and 
refinen^nt of the skills learnt in technical school. -In brief. Griffin 
argued that the trend in the development of apprenticeship training has been 
towards greater formality involving more direct instruction in technical 
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schools or similar institutions. Ryrie and Weir (1978) noted similar trends 
in apprenticeship in Great Britain. 

In his analysis of apprenticeship Griffin postulated "three distinct 
coii|3onents: induction, instruction and exposure* The induction component 
was seen, as that time. during which the ^prentice became oriented to the 
occupation and tKe world of work in general. It corresponds to some o^ the 
shorter pre-q^prenticeship prograin^, though it has not yet received wide 
recognition. Formal technical schooling provides the major part of the 
instruction coix?)onent during which both trade thepry and skills are . 
systematically taught. Finally; Griffin recognized an exposur^^^'^^on^nent 
during which an apprentice had time and opportunity to refine and develop 
skills. It' was acknowledged that in skilled trades adequate tiu^ for this 
process was very iiaportant. Griffin's analysis of the main co^onents of 
apprentice training is valuable in specifying the es'sentiai elements of the 
process. It enables one to examine the system, and alternatives to it, from 
a new perspective. Even nuare importantly it provides a framework around 
which alternative proposals for training in the skilled trades can be 
structured. 

Evidence supporting apprenticeship ' 

A recent review of national policy on the transition from school to work in 
Australia concluded that: 

It is our^^view, based on the evidence we received, that the apprentice- 
ship system has served Australia well and that it should not be swept 
away unless soB^thing better is put in its place. 

^ , , ^ (OECD, 1,977*: 54) 

Part of the appeal of the apprenticeship system is that it provides a form 
of practical training that is ba^ed on actual work experience. Through 
apprenticeship young people are able to develop vocationally useful' skills, 
and practise those skills under the conditions of real employment, f Moreover 
they Qf\)oy a.rapasure of financial independence, and the. valuable experience 
of working with adults as colleagues. As argued in more detail later in this 
chapter this is 'probably as importajit in the transition from school to work 
as the acquisition of vocational skills. At this stage it is sufficient to 
recognize that advocates of the apprenticeship system argue a strong case in 
terms of the developiaental needs of young people. Moreover, the case is 
supported by some research evidence. , " 

■ Recent research Studies of the entry of yoinig people into dtJult society 
(Wright and Headlam, ipj6) and of young' people at work (ACtU, 1975) have 
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ccmciiided that apprentices and nm^cs were a»ong the »ost satisfied 18 year- 
olds. Wright and Headlam argued that the co^ination of learning with working 
and earning provided a vliluable contribution toward the for»ation of personal 
identity of the young people involved- They gained confidence as the^ increased 
in coapetence and felt useful because they were engaged in real work. 

Probleps 

' \ * 

In spite of this the Organization for Econo^c Co-operation and Development 
(1977) noted that the ^pr«iticeship systes was under challenge. As some of 
the difficulties of the ^prenticeship system have led to an interest in 
various types of pre-vocational programs they deaiand consideration. 

One of the problems facing the apprenticeship system has already been 
discussed at length: the capacity of tjie system is constrained by ^the level 
of activity, in industiy. An additional consequence of this for some young 
people is that they may be denied the opportunity to study in a field that 
interests them because no alternative to ^prenticeship exists in some 
occi;5>ations . The present system appears to require young people to obtain a 
job before they can obtain education in an area. 

, The capacity of the apprenticeship systems as %\ exists at present, seems 
to be restricted increasingly by two additional factors: a reluctance on the 
part^ of employers to train apprentices, and structural changes in many ind^JP^^Wes 

The reluctance of enyloyers to train apprentices was ascribed by the 
OECD (1977:53) to the costs of training. A report by the Commission o I Enquiry 
into Apprenticeship in Queensland commented that: 

there is isuich evidence of a positive' reluctance developing on the part of 
a significant' number of employers to e^loying and training more than a 
minimal nuiaber of apprentices and in ^ome cases no apprentices at all for 
the present. 

(Anderson", 1976) 

The report observed the tendency for some employers to recruit skilled trades- 
men who had been trained by other employers or government, instrumentalities so 
as to reduce costs. Most importantly the report expressed the opinion that 
this attitude was becoming more widespread. The problem^ had not arisen simply 
as a result of the present economic recession. A similar enquiry in New South 
Wales some eight years earlier noted that the costs of training tended to deter 
enployers from taking on apprentices (Beattie, 1968). 

Subsidies and rebates to eaiployers who train apprentices have been 
introduced to reduce the effect of this cost deterrent. In Addition to the 
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problw of costs it s«e«s that soae employers consider' th^t the lower 
productivity of new apprentices deters ,the« itom taking additional appren* ' 
tices. They contcad that w>rking tiaut mist be allowed to teach basic skills 
to b,e covered at later stages in their technical coisrses* 

This latter problra of a, lack of occupational skills is seen as one to 
which pre-vocational courses ccnild be directed. Such courses, it is argued^ 
would provide young people with sufficient basic skills to be iiwediateiy ' • 
Useful eaployees and to continue their training as apprentices. Sose pro- 
ponents of this fora of training i^uld wish the entire training progrsM to 
be completed on a full-tiae basis , thus shifting the cost of training 

* entirely to the public sector. \ 
* ^ . , 

Structural changes in some industries have resulted in fewer opportuni^ 

ties for apprentice training. For example » in the building and construction 

industry Kich Work which was once done by general builders is now done by 

specialist sub-contractors. Consequently thete are now fewer builders and 

building firss able to offer the g^eral tt^aining for apprentices in this 

industry/ While some say reach special arrangements with sub-contractors, 

there has been a general reduction in opportunities for apprenticeship in 

this industry^ The trend in the building industry in New South Kales has been 

extensively documented (New South Wales Department of Technical Education, 

1973b) and is probably true for other states. Even though a change such as 

this results in fewer opportunities for tradesmen to be employed in general 

building work it does not mean that they should not be trained in the varied 

skills of the building industry. To train for just one specific aspect of 

the industry would limit their future adaptability. Hence the problem which 

has emerged is that pf how to provide such a general training when the 

industry can offer few suitable places for apprentices. 

Not all the problems of ^he apprenticeship system derive from a lack of 
places for training in industry, ftie frequently mentioned problem is that of 
'wastage' during and just after coisgJleting an apprenticeship. On average about 
6,000 indentures were cancelled each year for the past five years. This can 
be viewed as either one twentieth of all apprentices or about one fifth -of 
each year's new intake. Over the duration of an apprenticeship of four years v 
it seems that about one fifth of a cohort discontinue's the apprenticeship. 
Compared witj^ other forms df post secondary education this is not so large 
^a^s^to warrant alarm. It seems that when providing for young people whose 
aspirations may change a number of withdrawals from courses should be expected. 
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Table 2.1 Reasons for CanceUaticm of .Apprenticeship Agreements 



Per ce^t for each Imk Groi^) - Nr csat 
i ' of all Total 



Elec- Build- Print- Trade cancel- 



fiaason 


Hetal 


trical 


i»S 


log 


Vehicle 


Food 


Otfwr 


Groups 


latiofl 


Misconduct 


9 


7 


10 


2 


8 


11 


'6 


.9 


527 


Change o£ . 
Residence 


7 


5 


11 


11 


6 


10, 


9 


8 


513 


Incapacity 


10 


9 


15 


8 


13 


7 


16 


12 ' 


745 


Loss of ^ 
Interest 


46 


38 


38 


55 


40 


43 


39 


41 


2564 


Traininc • 
Problese 


8 


20 


10 


6 


5 


4 


■ 6 


■ 9 


533 


Other'^ 


19 


21 


16 


18 


28 




■ 23 


21 


1320 


Total 
Cancellations 


1771 


665 


li04 


126 


741 


555. 


1239 


100 


6201 


Per cent of 
Average New 
^prentices 
over last 3 
years 


13 


IS 


17 


13 


26 


23 


23 


* 


r 

18 



a * 

Includes entry into other occupation of an unsatisfactory work record 

^ Includes lack of aptitude* 'Inability to cope with the technical course, 
dissatisfaction with training and the inability of the employer to provide 
work, , ' 

f 

^ Includes financial difficulties 

I 

Source: Australian ^prenticeship Advisory Committee (1978) , 



More detailed Inforraation about the cancellations of apprenticeship agre^ents 
is shown in Table 2.1. From those data it can be seen that the most coBMn 
reason cited for cancellation is loss of interest. The inability to cope with 
the technical course accounts for only nine per cent of cancellations. Improved 
selection based on tests of ability is therefore unlikely to reduce the total 
number of cancellations greatly. Greater attention to the 'induction compon- 
ent* of training sight enable potential apprentices to be better informed about 
their own interests and the wrk which would be required of thens so that there 
are fewer losses to the system through 'loss of interest*.' Pre-vocational 
education programs of various types could.be seen a| a means of providing a 
better induction to apprenticeship. 
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* An. additional problem confronting the appreAticeship system is that the 
jobs taken by- apprentices as part of their training vary in the quality of the 
trailing they provide. .Richardson and dayman (1974) reported that about half . 
of a sample of Fitting\^and Machining apprentices considered that they^ad not 
received systematic on-the-job training. Many/apprentices felt let down. In 
part, the problem arise%^from the nature of am)renticeship arrangements which 
often do not allow for sufficient integration of theory and practice. Even^ 
though they were generous in their comments about the apprenticeship system, 
Wright and Headlam (1976) drew attention to ^he problems' of some apprentices 
in linking their technical training and tfieir job experience. The National 
Training Council C1977b) notes that such a /problem may arise when the tech- 
nical training is broad based but the job ^xperience is narrow. Some dis- 
junction between training ajul experience is probably inevitable because 
apprentices will be employed in so mny different jobs. Only in the group 
training scheMS described by Griffin (1978) does it appear possible to avoid 
this problem. In jh^inciple a period of full -time training prior to apprentice- 
ship would provide an opportunity to co-ordinate theory with practice. How- 
ever, if the apprentices interviewed by Wright and Headlam are typical, the 
practice opportunities *in sixth a program would need to be similar to those 
in real work. Evidence from Britain suggests that where there was close con- 
tact between a college and the firms which employed the apprentices in its 
courses the success rate was higher (Venables, 1967). Yet Richardson and 
dayman (1975) noted that a significant i^umber of employers of Fitting and 
Machining apprentices did ru>t perceive an obligation to provide a varied 
and ^^^Aftoatic program of on-the-job training. 

It has been claiined that many apprentices leave school with deficiencies 
in basic mathematical and verbal skills (TAFEC, 1977:42). Raftery (1976) has 

Jggested that such deficiencies are a serious impediment to success in 
prenticeship . Another study (Stock, 197§) indicated that While many 
prentices needed remedial raathematics and reading instruction they did not 
ore lowly on tests of general ability. Though It could be argued that the 
development of these skills is the responsibility of the school system, 
there is an apparent need to develop the basic skills of potential apprentices 
to a higher level. However, it ought to be possible to identify more 
precisely the, skills needed as prerequisites for apprenticeship in particular 
trades and 4evelop those at p\e start' of an apprenticeship. Such an activity 
would have the advantage of being seen as vocational ly- relevant by the 
students. There is some evidence that an improvement in basic skills can be 
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obtained by reacdial prograas^which are seen as vocationally relevant (Walker 
and Robscm» 1976), Beeson (1978) has argued that attention should be focused 
on overcoming specific deficiencies in the background knowledge of beginning 
TAPE students. He contended that such an approach would be a Bore effective 
'wajr of iujproving the performance'©^ students in their TAPE courses. An 
important elexaent in this arguaent is that it would be necessary to identify 
specific prerequisite knowledge for the program students are to enter. Once 
important prerequisites have been identified it would be possible to develop 
teachiitg and learning strategies to overcome deficiencies in that prerequisite 
knowledge. An application of this approach to an introductory physics course ^ 
in some Melbourne TAPE colleges was success^l in helping students overcoM 
deficiencies in prerequisite intellectual skills. On this basis it was 
suggested that the approach had wider applicability (Beeson, 1978:70-75). 
^ The application of this approach to training in Skilled trades could be 

included as part of pre-vocational education. It would probably be more 

■ ^ 

effective than resiedial programs directed to more general aspects of literacy 
and nuiaeracy. 

Xtvt problems mentioned in relation to apprenticeship do not, in general, 
^ coilcem the principles -fin which the system is base3. Rather they concern 
difficulties involved in sustainiHg the systel^ mainly in terms of providing 
suitable en^jloyment which involves training. It would seem important that 
any con^jlementary arrangements to apprenticeship in trade training should 
recognize those aspects of apprenticeship which seem to provide effective 
training and satisfaction for the students: adult treatment, financial 
independence, and realistic work tasks. 

. ♦ Secondary School Curricula 

It is well known that the proportion of young people continuing full-time 
schooling beyond the age at which attendance ceases to be compulsory grew 
rapidly during the sixties and seventies in roost industrialized 'countries , 
In Australia in 1964, 38 per cent of 16 year-olds and 17 per cent of 17 year- 
olds were enrolled" full-time in school. By 1972 the" figures had risen to 55 
. and 50 per cent respectively (OECD, 1977:33). Even though the rate of growth 

has slowed since then, the proportions of 16 and 17 year-olds at school have 
\ remained high. Only very recently in some states has there been evidence of 
a fall in the retention rate of males. Fitzgerald (1971) documented the way 
in which the rapid growth of upper secondary enrolments in Australia affected 
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the organization and structure of secondary schools. A sisilar analysis of 
the analogous changes in Western European countries has been reported by 
King, Moor and Mumiy (1974). In both these analyses attention was focused 
(^n the wider range of social backgrounds, attainment levels, interests and 
aspirations of students now involved in post compulsory education* Secondary 
schools were obliged to review their traditional curricula. 

It was noted by Mackay C1977b) that aany potential apprentices who could 
not find ^loywent returned to school in Year 11, It is possible that other 
young people who wish to leave school after Year 10 return to school because 
of the lack of available employment. Some of the more general pre-vocaticmal 
courses are sometimes supported on the basis that they provide an alxemative 
form of post compulsory education for such people (C^eensland Department of 
Education, 197Sa} . In support of these courses it is argued that they are 
most rewarding for students whose interest is not primarily in academic 
subjects - 

One study conducted at the Australian Council for Educational Research 
(Rosier, 1978) showed that family environment was less strongly associated 
with the decision to leave school at the coi^ulsory age among Victorian and 
South Australian students than among their peers in other states « It is 
interesting that these were the two states which at the time the data were 
collected operated secondary technical schools. The possibility exists that 
the curricula of those schools proved attractive to students who would other- 
wise have left school* Another study by Connell et al. (1975:301) concluded 
that even though schools covered traditional scholarly disciplines well, 
soae young people found them insufficiently related to the social and 
vocational requirements of the society. Poole (1978:13) also 
suggested that many students desired a much closer link between school and 
work. This evidence does nof necessarily suggest that all senior school 
programs ought to be changed so that they are more practical. Rather it 
suggests, that there is .a group of students to whom a more vocationally 
oriented form of schooling would be attractive. 

In it* 1976 Review of Educational Policy in Australia, the Organization 
for Economic Co-operation and Development reported that there was a growing 
belief that young people would be given a better start in adult life if they 
sensed personal achievement rather than academic failure (OECD, 1976:18) . 

This view is reflected in the arguments for a polytechnical pre- 
vocational program by the Queensland Department of Education (1978). That 
body argued that an educational program oriented to practical skills would 
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provide encourageaent for those whose academic achiev^ent ras low ^better 
fit thea to progress into society as informed and adequately prepared yoOng 
adults'. Morrison (1973) reviewed a nuahcr of studies vSiich supported the 
view that continued failure resulted in Ic^er levels of self-esteea. Results 
froa her own research were consistent with this general conclusion though she 
noted each successive failure does not lower self-esteem by an equal amount *0 
soBie adaptation occurs. * ^ 

The argument offered for pre- vocational , education programs as an 
alternative foiS of post cos^ulsory education is one for greater diversity. 
At present full-time post con^sulsory education does not include much 
opportunity for study of skilled trades. It is contended that full- time study, 
intthis area m|y provide an i^ortant alternative means for the general 
edm:ation of a significant group of young people. 

The Transition from School to Work 

Thr three aspects of the rationale for pre- vocational education discussed so 
far have coijcemed specific problems to which pre-vocational education has 
Been seen to provide solutions^ It remains to discuss the more general issue 
of the transition from school to work. 

A recent report by the Technical and Further Education Commission considered 
that pre-vocational education programs in Technical and Further Education could 
assist some young people make a successful transition^ from school to work 
(TAFEC, 1977:125), This aspect of the program certainly evokes wide interest: 
an interest which seems to have been stimulated by the increasetd levels of 
youth unemployment y * ' 

Problems associated with young people in Australia leaving school to 
start work have been the subject of reports by th^ CoimDonwealth Department 
of Education (1976a) and the Organization for Hconomic Coroperation and 
Development (1977). Yet it should be emphasized that the issue of a 
successful transition from school to work involves more than obtaining a job. 
The problems involved ^^e transition from school to work are in part the 
problems of adjustment to adult life. In leaving secondary school a young 
person is moving from a sheltered environment to one which presents new re- 
quirements. At the simplest level these requirements involve longer hours 
and unfamiliar procedures, Ntore profoundly they involve adapting to a role 
in an organization, working with people of a wide range or ages, becoming 
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familiar with the values and behaviour of the employer and £ellow employees, 
being expected to work without cimstant supervision, being held responsible 
for one's action and experiencing punishment in other than a personal sense. 
The problems of leaving school and starting* work se«B especially great for ^ 
those young people 'vSfeio eisbark on this transition before they are psychologi- 
cally and socially equipped 'for work. Because work looms large in coaynunity 
expectations of adult life, probl^s encountered in this transition seem 
likely to have far reaching repercuss*ions on the personal develoj^ent of 
young people, 

A problem in discussing the transition from school to work is that 
important terms- are seldom defined. What is meant by a successful transition 
is a particularly ephemeral notion. The simplest criterion might be whether 
or not a young persbn obtained a job on leaving school. Beyond that might be 
added a measure of whether the job obtained was comensurate with the person's 
skill. These two criteria correspond to the notions of unemployment and under- 
employment. Lewis (1976) in a sti^y of success in transition of Year 12 
students in Australia, added the complmentary criterion of whether a young 
person retained a job, i.e. job stability. In the present study a considera- 
tion of satisfaction in the work environment has been proposed as a'^urther 
criterion in examining the transition from school to work. In brief, an 
analysis of the transition from school involves unemployment, under-employ- 
ment, job stability, and job satisfaction/ 

Formal educational programs are limited in several ways from assisting 
young people make the transition from s^^l to work- '* 

Firstly, it would appear most unlikely that any educational program could 
have a general impact on the level o£§youth unemployment. Even when applauding 
the development of the type of pre-vocational program considered in this study 
a recent report cautioned: 

Such courses are not a panacea for all the problems of youth unemploy- 
ment, for example, they can do nothing* to overcome a general lack of 
employment opportunities due to the level of economic activity. What 
they should do, however, is to improve the motivation, skills, learnings 
techniques and self-esteem of people who might otherwise be unemployed^ 
assist in training people in areas of skill shortage where jobs are ( 
available; and provide an investment in improved productivity against' 
the time when the economy picks up. 

(TA^-EC, 1977:150) 

\^ It is possible that some programs may act as job creation scliemes. One 
means by which this co\iid happen is that hovel and" valuable skills might be 
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developod, so th^t new types of job are created where none previously existed. 
Another po$sibility is that the graduates of sose prograas might be so ispres- * 
sive that the ar^loyers hire thM in addition to their normal .$taff . Neither 
of these means of job creation seem very likely. Another possible means by 
which pre-vocational programs might have some impact on youth unemployment is 
by developing skills in occupational areas where there is a shortage of skilled 
labour. However, as argued ^rlier, eyeit if there are so&e specific areas of 
skill shortages, filling those positions would olily h^ve a slight impact on 

' 4 

the general level of youth employment. 

Secondly, given that a successful transition from school to work involves 
more than obtaining a job, the development of new. educational ptx)grams attacks 
only one part of the problem.- The other part of the probl^ is the nature and 
^structure of work, Wirtz (1977) has argued strongly that to facilitate the 
transition from school to work requires more than better vocational programs. 
Changes in w<Srking conditions which result in a myre satisfying working life 
are equally important. It is a theme which is now being mentioned, frequently 
in the literature on school to work transition (Mills, 1977; Husin, 1^75; 
Thorsrud, 1977) and merits serimus consideration. At the very least it 
ought to caution us against expecting too much from new educatit)nal programs. 

A final possible limitation on the effectiveness of new programs in 
.coping with the transition from school to work is that of the institutional 
framework in which they are cojjylucted. The future of institutional schooling 
for adolescents of age greater than about 16, has recently come under careful 
scrutiny (Bulcock, 1976; Hus^n and Bulcock, 1976) with a view to utifizing 
other agencies for initiating young people into adult! life. In part this 
proposition has arisen because the conditions of senior secondary schools do 
not provide sufficient similarities with the world of work. The programs 
considered in this study have attempted to overcome these difficulties in a 
vaWety of ways and provide interesting innovations in this area. 

Even thou^ these limitations need to be acknowledged, it should not be 
inferred that there is no place for pre'-vot:ational education in^the 
transition from school ^to work. It is worth considering the means by which 
such programs might be expected to have an impact in this area, O'Toole 
(1977) has identified the major goals of career education in the United States 
which appear to be similar to the goals of pre-vocational programs in Australia. 

1 The provision of skills; | 

2 The development of appropriate attitudes; 



3 The provision of iiiformation about careers. 
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Some of the problems associated with the e^qjectation that providirrg skills 
will ease youth uneaployment have been aentioned earlier in this report. In 
brief, such an expectation appears to be based on an assusf^tion that under- 
lying youth une^loyaent is a shortage of skills. Nor is the assuogtion that 
increasingly high levels of skill are required in the labour market e^y to 
sustain (Berg, 1973)- It would sees that the acquisition of new skills isight 
-affect at best, the relative position of an individual in. the job queue. In 
any event the eiiployment record of graduates of vocational courses in the 
United States aine^f at skill development, is not better than that of graduates 
^of general courses (O'Toole, 1977). It seems that in the United States many ^ 
employers do not demand school graduates with specific skills but would rather 
provide training themselves (O'Toole, 1977). The saae compents are possibly 
true of Australian eiaployers. 

Any consideration of the provision of skills needs to take into account 
the degree of job mobility in modem industrial societies. One recent analysis' 
(Pratzner, 1978) argued that because of the degree of job mobility vocational 
education prograais should be directed to occupational adaptability and 
transferable skills. Vocational educational programs, it>^ argued, should 
prepare not only for a job but for work careers characterized by change. The 
problem encountered by Pratzner (1978) was in identifying transferable skills. 
While there was consensus about a number of broad categories there did not 
^pear to be a single agreed list of ikills applicable across a broad range 
of settings. Faced with this problem Tratzner (1978) argued that because all 
skills were potentially transferable/ the process of transfer was of paramount 
iu^iortance. He contended that the idea of teaching for transfer shdfuld 
explicitly perroate a whole program and should be supported by providing 
students with^the opportunity to practise and use their skills and knowledge 
unde^ a wide variety of conditions. 

Viewed in this light the provision of transferable occupational skills 
through pre-vocational programs is an important issue. Skills developed 
with this objective in mind would aim to provide a person with the capacity 
to do a great aany things not necessarily related to their immediat^e ' 
employment. As one example the skills of carpentry are not wasted pn a 
person who does not become a carpenter. They may j)^ovide a valuable and 
satisfying basis for many other activities. This conception of the skilly 
which ought to be provided through pre-vocational programs involves a broader 
vision of the role of those programs. It sees them as directed towards the 
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transition fro* youth Jo adult life rather than fro® school to work, practical 
skills are seen as related to a range of ^possible occupations knd- leisiire ti»e 
activities. Consequently vocational courses »ay be directly related to^ the 
student's continuing personal develo^aent. 

The development of appropriate attitudes to work is another way in which 
it is claimed that forsal programs of vocational education may assist the 
transition from school to work. Some evidence presented by 0 'Toole (1977) 
suggests that attitudes to work are ioportant factors in obtaining or retaining 
a job. Such a view is consistent 'with the claim by Edgley (1977) that when 
eiployers talk of a l^ck of skills among young e^loyees they mean a lack of 
what they consider to be appropriate attitudes. In spite of this, attitude 
development is probably the most controversial aspect of vocational education. 

^ Some critics of vocational education claim. that what is intended is to 

develop compliant and submissive attitirfes among young workers (Edgley, 1977). 

It is argued that by such meaits esaployers will have tighter control and 

eoaployees will be more willing to tolerate boring and repetitive jobs* Other 

critics have concentrated on the limited development of a further groxxp of 

'« 

attitudes. O^Toole contends that through an emphasis <m^the development of 

r 

skills students are not encouraged to think about broader socxal issues. In 
this, way they are ill-prepared for participative citizenship* It is this 
aspect of vocational programs that seem, to have proi^ted Wirth (1977) and 
Bledstein (1977) to support developments in which there is a fusion of liberal\ 
and vocational education. 

It would appear that the challenge involved in this aspect of vocational 
education is to define what attitudes^ if any, should be developed, and how 
best to develop them. As an initial contribution to this challenge we would 
suggest that a distinction be made between attitudes to work and attitudes to 
employment. There may be it^ortant attiti^es towards the satisfaction of 
co8|)leting a piece of work thoroughly which are not dependent on being either 
coB^>liant or rebellious towards an employer. A consnitment to good work 
seems to be one in^jortant attitude to work which does not necessarily depend 
xxpan acceptance of an existing social structure. Other aspects of attitudes 
to work which can be considered in this context are vocational maturity and 
occiqjational identity. These are discussed in more detail later in this 
section. As a second contribution to this challenge we would ar^e that an ^ 
important part of preparation for work is to understand the social-industrial 
structure which one enters. If such an element is not consciously incliided 
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in vocational courses there is the risk of developing .the attitude that i 
anything' which does not involve technical skills is ujjii^ortant* It is in 
this respect that curriculum develc^iaents which involve a fusion of liberal 
and vocational education are crucial. Watson (1973) has identified a nuid>er 
of issues involved in providing liberal studiejs within vocational programs mnd 
described alternative rfg^ for achieving this. What is needed is to provide 
liberal studies which are directly relevant to particular vocational progr^. 
Students are then better placed to relate the various aspects of their course. 

In brief, we recognize that the attitude cos^jonent of pre-vocational 
education needs careful consideration. We argue for a separation of attitudes 
to work from attitudes to e^loyiaent, and for^^he provision of sufficient 
information about social-industrial structures to enable individuals to form 
their attitudes to employment on a rational basis. Understanding the soHal- 
industrial structures involved in es^jloyront is probably ii^rtant for 
graduates of pre-vocational courses in view of their need to adapt to the 
requirements of^a first job. Hwever, it seems necessary to assert that to 
provide information about eiaploy^nt rojes so that an individual may adapt 
behaviour ought not necessarily involve an encouragement of passive acceptance 
of an existing structure, ^ % ' 

We do not pretend that the attitudes to work we have proposed are value 
free. However, we do contend that the values are more general and not 
dependent on a particular view of the roles of employers and e^loyees. One 
attitude to work which we have considered is that of occupational identity: 
the extent to which students come to regard* themselves as workers (!*isgrove, 
1967). Another ic^^ortant dimension is that of Vocational Maturity, which 
incorporates the notion of a preference for, and an ability to, make rational 
choices about work and careers (Crites, 1969). ' One study which examined the 
vocational maturity of students undergoing a course of vocational training 
yielded some interestj.ng^ results (Purcel et al. , 1972), Using the Attitude 
Scale of the Career Maturity Inventory as the criterion it found differential 
effects of vocational* training. Students of technical programs showed gains, 
on the criterion while students of clerical programs showed declines. In 
addition it was found that the gains of the former group were about the same 
as the gains of their peers who started work directly. A further 11 lustra- - 
tion of tfre types of attitude envisaged as an attitude to work, rather than 
an attitude to employment, is- that of need for achievement. Bachman et al. 
(1967) studied the need for adiievement through work as part of the Youth in 
Transition Project. The scale which was used was more directly related to 
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the world of wxk than many to^asures of n^ed jfor achievemrat* It did not 
siiiply assess /asbltlon' but rather the extent^ to which an individual desired 
to achieve satisfaction throug^t work: an iji^rtant aspect of" pre-vocational 
education. .* 

The third area in which full-tiae pre-vocatxonal education aight asf^ist in 
the transition froB school to work is in the provision of a broad knowledge 
of possible career opportunities. More adequate career information clearly 
cannot reduce youth eaploynent thou^ it could possibly reduce the duration 
of uneaployment by providing the capacity for aore effective job seekiiig. 
It can also aae-liorate some of the problems. of perceived undereB5)loyment by 
enabling students to fora realistic expectations'^ of jobs. The sort of 
information which can be provided is of two .types. Firstly, young people 
can be helped to discover their oWn interests and abilities. Secondly, the. 
requixements of a range of jobs can be made known to them* Overhand above 
this they can learn how best to adapt their interests and abilities to*the 
of jobs which might be available. The i^iortancQ of providing career 
ition^is recognized in career education programs in secondary schools 
and InUink programs in TeclHiic^l and^ Further Education (Blakers, 1978). 
Full-time pre-vocational programs are able to provide more detailed information 
about careers,. in a more limited field. They ^im to enable a student to ^ 
discover his capacity for work in that field. 

A most in5)ortant way in which pre-vocational education^p:^ograms might assist 
in the development of each of these thi^ee outcon^s and hence in the transi- 
tion from school to work is through the pi«^vi§,ion of work-related tasks^ in a 
simulated work environment. In this respett thci program could , provide two 
iii|5ortant" bridges between school and adult life. Firstly, it might provide a 
gradual introduction to a working environment: an introduction diiring which 
the penalty for failure is less severe arid in which guidance can be offered. 
Students can become accustomed to longer hours of work and the ^different types* 
of restriction and freedom which an^ adult worker encounters. They can also 

learn the standards of workmanship which are expected of them. Nksre' 

^ii^ortantly in technical college courses they tsight learn inforraally from 
teachers who have some experience of industry about aspects of working Uife 
not easily incorporated into a formal curriculum. ^ I 

-Secondly, this type of experience^can have a much broader value the 
transition from youth to adulthood. Erikson (1968) has argued that work 
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experience durii^g adolescence is v&luable^in identity formation.^ Many 
young people axe now denied such an opportunity because of the 5}K>rtage of 
jobs and the prfssure to remain at secoi^ry school. TKe provi-sion of siich 
c^tperience in a supportive environment holds the possibility of rectifying 
this deficiency. Coleaan et a^; (1973) reinforce this View referring to the 
exploratory period in which young people examine jobs and careers in te^s 
of their interests, abilities and values and the requiresients of work. As' 
Coleman et^ al_. (1973:158) ar^e the aim of such an exercise should ^ot be 
prii^ily 'to learn a skill but to give experience in responsible inter- 
dependent activity'. There is evidence that the isore siailar such experience 
ii to real work the more effective it is in facilitating the transition froa 
youth to adulthood (Shore, 1971). ^ 

ColOTan et al_. (1973:142) argue that it is difficult to provide ^ch 
experience in schools. They contemi that in school a student is dependent 
and the school is responsible for shepherding his developraent* yet if the 
student Jg^ develop, he needs to be^iven the responsibility for making 
decisions. To reorganize a school so that young people have responsibility 
and authority, they argue, is incompatible with the basic custodial function 
of a school, Furtherrore, it is argued by Coleman et al^. that an important 
part of the maturation of youth involves working with people of different 
ages. In schools, students work with- others of similar age under the direc- 
txpn of an older person. , 

If this argument is valid then this sort of experience is best provided 
outside schools ip real iobs. One response to this xs the developTCnt of 
work experience programs of various types in secondary schooi^s ^Blakers, 1978). 
Host of these involve relatively short periods of wprkihg in jobs arranged by 
the school. These periods of work axe probably valuable- in -learning what a 
particular job is like and in gaining soa^e ejgierience of the conventions of 
working life. However, limited research in the United States has suggested 
that the iin)act of such programs depends very muah on how well ^hey are planned 
and the types of job made available (Stakleton and Magisos, 1975). In some 
cases Freedaan (1963) found that having a job tended to make students 

■ • ■ ^ 

^ E^-iksoti has written extensively on the term identity. He sees adolescence 
as a period of identity formation during which an individual comes to kno^^ 
himself in relation to his own capacities and the environment in which he 
' is placed. 
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inpatient with th« denttuls of the school getting. Full-tiae pre-vocational 
education prograjis of the type considered in this report offer an alterna- 
tive approach to providing this type of experience if in these programs the 
conditions of the learning environsent are made as similar as possible to 
a working environment. Tasks would be made similar to real jobs, and in a few 
cases be real canstnu:tion jobs. Moreover the instructors would need to be 
people with ejqperienc^ of working in the field in which they teach. Of 
course/ the tasks can never be real tasks in the true sense, their instructors 
cannot conpletely discard their pastoral role, nor can the program provide 
the opportunity to work with people of different ages. To acknowledge these 
problems i^ to recognize the difficulties in providing a surrogate for the 
world of work. Short work experience programs face other diJCficuUies such 
as the unavailability of sufficient suitable jobs and the tension 
experienced on return to school. In the present economic climate it seems 
.unlikely that real work experience of sufficient duration could be provided 
on a widespread basis. Yet the issue is so crucial that it seems worth 
exploring alternative means by which young people might gain some of the 
experience of entering work. 

Throughout this disc^ussion it has been stressed that the transition 
from school to work should be seen as but one co^onent of the transition 
from youth to adulthood. For this reason it has been argued that the criteria 
for a s^J^essful transition should be broader than the o'^taining of a job. 
They should include retai;iiring a job which utilizes an individual's capacity, 
and the satisfaction experienced in adapting to a new environment. Such a 
view enables the role of pre-vocatibnal education in "this transition to be 
examined frpm a broader perspective than whether students obtain jobs: a 
criterion which is dependent on so many factors outside the course - 

In Summary 

Pre-vocational education has been advanced by various groups as a potential 
solution to a variety of problems: manpower demands, deficiencies in 
apprenticeship training and senior iic^l curricula and the transition 
from school to work. Since many of these problems have elements in cotmson, 
the major theses in the arguments for pre-vocational education are inter- 
related* ^ven though many of the problem areas discussed in this chapter 
are interrelated, they provide an indication of the environment in which 
the new courses were introduced ^ 
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Froa the discussion of ^jre-vocational education* in relation to these 
problem areas, it is possible to abstract three, underlying arguments for its 
developoent. For our ^jrposes these adeqiiately sum up the rationale advanced 
^ for pre-vocational education by its supporters. 

One type of argument could be described as organizational/ economic. 
This argument has considered the effectiveness of pre-vocational education 
•ainly in texias of the capacity ami responsiveness of the training system. 
In brief, pre-vocational education has been, supported as a means of pro- 
viding skilled training, which takes account of structural change in industry 
and which shifts training costs fro® the private to the public sector. With 
respect to this argument it needs to be noted that soxoe dispute exists 
concerning estimates of the deaand for skilled labour. This arguiaent has 
hot generally considered tHe effectiveness of pre-vocational edtication in 
the development of occupational skills. 

A second type of argument has concerned the effectiveness of pre- 
vocational education in terms of the development of occupational skills. 
This type of argument could be described as occiq)ational -educational , It has 
been manifest in concern over the nature and breadth of training provided in 
industry as part of apprenticeship, and in concern at the level of intro- 
ductory skills which young people possess at the co^^ncement of their term 
of apprenticeship. It has been evident also in discussion about trade train- 
ing in occupations not served by the apprenticeship system. 

Finally, the third type of argument has involved the broader development 
of individuals. It has been concerned with more general educational objectives 
which are equally inportant in adapting to work and general living as an adult • 
iUis type of argument could be described as a general educational argument. 
From the viewpoint of this argun^nt the development of useful skills, and the 
provision of valuable experience in pre-vocational education, is directed 
toward an individual's personal development and maturity. In these terms 
pre-vocational education has been seen as an aitematj^ve to other forms of 
post-compulsory education which would suit some young people. Most 
importantly it has beefn seen as a form of post -compulsory education which 
would assist in the transition from school to adult life. 

A number of possible research issues are raised by each of these three 
types of argument. The present study has been concerned- with developing an 
approach to the evaluation of educational aspects' of programs of pre- 
vocational education. In particular it has concentrated on those issues 
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ia|)ortant to the d«v«iopMnt of curricula suited to progrmu of pre- 
vocational education. That seeud to be the issue »ost relevant to state 
authorities .fJid coUeges in the conduct of »ich programs. 
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CHAPTER 3 
POUR PROGRAMS 

At tht beginning of the previ«»is chapter foyr types of program which were 
considered to T)e pre-vocational were specified, 

1 Pre-apprenticeship programs intwided to lead directly to an apprentice- 
ship in a particular trade. 

2 Progra«js intended to provide work preparation in areas for which training 
has not been provided in the apprenticeship system, 

3 Polytechnical programs designed to provide an introduction to a range 
of trades with sc^ie specialization later in the course. 

4 Courses of full-time study intended to lead to a combinaticm of wort- 
and further part-tii^ study other than through apprenticeship, - 

The present chapter contains a brief description of the essential 
features of one program from each of these categories. It ii wsrth repjsating 
the comment from Chapter One that while these programs incoi*porate important 
features of the newer pre-vocational prograa^s they are not necessarily typical 
of the full range of programs in the area, 

Pre-Apprenticeship in Carpentry and Joinery 

) 

The general context 

During the early .seventies the New South Wales Department of Technical and 
Further Education introduced a series of * pre-employment trade courses' 
whereby students attended a program of full time instruction in one or more 
trades prior to entering an apprenticeship. These were originally described 
as pre-employment trade courses to differentiate them from a previous system 
of pre-apprenticeship courses. In practice the new courses were in accord 
with the definition of pre-apprenticeship training adopted by the Australian 
Apprenticeship Advisory Committee: 

Pre-apprenticeship (or pre-employment) is a training system in which 
trainees, normally school leavers, study full -time at technical 
training institutes for periods usually ranging from 18 weeks to 42 
weeks before formally entering into an apprenticeship under special 
conditions. 

(Australian Apprenticeship Advisory Committee, 1976) 
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Pros 1978 onw&rdi tl^ pxe-^eaployn^nt trade courses in New South^^ttales have 
.been designated pre-apprenticeship. This new termimology will be used in the 
^ptei^ent report henc<f forth* 

In its stated rationale forkhe establishoent of . these coui/ses the New 
South Wales Departaieat of Technic^ and Further Education ment^ned many of 
the points disci&sed in Chapter TwoL Specifically aention^ were the ne^ 
*to increase the range in the possftle avenues of education open to students 
of the 16 plus age groups* and the belief *that the training need is not 
being adequately n»t by the established apprenticeship^system' (New South 
Wales Defbrtment of Technical and Further Education/ 1975:4). 

The range of trades eoibraced by these courses is broad, though the number 
of students in e^ich program is relatively small compared to those in appren- 
ticeship. In 1977 there were 1,S28 enrolled in the various pre-apprenticeship 
courses in New South Males, while there were about 51,000 apprentices of whom 
about 11,000 were new apprentices. However it can be seen from Table 3.1 
that enro^ents in pre-apprenticeship courses have grown at a more rapid rate 
than new Apprenticeships, Keller and Naylor (1978) have documented the way 
pre-appremiceship enrolments are divided- amongst the different trades. These 
data have been recorded in Table 3.2. It can be seen that carpentry and 
joinery had the largest enrolment of the pre-apprenticeship com-ses in 1977. 

In.^$7S there were 348 pre-apprenticeship carpentry and joinery students 
compared to 3,265 day release apprenticeship students, ^f the pre-apprenticeship 
students 125 were in metropolitan centres and 223 were in country centres. 
5^J3Hji|k ratio of pre-apprenticeship to apprenticeship cajrpentry and joinery students 
inljfhe Vountry was approximately double that in the tit^y, 

CoiJ^e* aims ' 

s - — ' 

Five general aims were specified for the pre-apgrenticeship course in 
carpentry and joinery in 1973. The listed aims were concerned mainly with 
the development of vpcational skills and knowledge. Ho^^er there was 
mention of 'practical andirelated instruction^, 'an appreciation of on-site 
procedures and organization' and an intention to develop a degree of peisonal 
responsibility in students. 

1 To provide the student- with both sufficient technical education and 
off-the-job training to enable him to coimnence employment with some 
of the usable skills of a carpenter and joiner and at an advanced stage 
of his apprenticeship. 
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Table 3.1 Pre-Appronticeship and Apprenticeship Enrolments in New South Wales 



y**" , Pre-Apprenticeship* New ^renticeship Total Apprenticeship''* 



1^73 263 11 160 42 221 

1^74 474 ' 12 ?66 46 097 

1975 691 13 189 50 067 

1576 903 ' 11 595 50 588 

1977 1 528 • 10 873 51 317 



Prior to 1978 these were known as pre-employment trade courses ' 

^ Derived from figures published by the Australian Apprenticeship Advisory 
^ Coaaaittee ^ . 

2 ^ To bring the student to a level of skill sufficient to enable him to 

enter the industry as an economic asset to his employer; it is 
intended that the employer could be a cottage builder or commercial/ 
industrial builder or a joiner or a shop ai^ office fitter or any of 
the other categories who employ carpenters and joiners, 

3 To provide practical and related instruction in all stages of the 

' construction of a single storey^ timber framed, pitched roof building 

4 to be erected as either a demountable or fixed building, 

4 To give an appreciation of on-site procedures and organizatipn. 'i 

5 To encourage the student to be the responsible master of his own thought 
and actions, both on and off the job, by developing in him a perspective 
of his role in the industry and a disposition to look for and gain from ' 
new learning situations. The subjects 'Life Oriented Studies* ai^ 
'Conssunications and Self Expression' have been designed to orientate the 
course towards achieving this end. 

(New South Wales Department of Technical and Further Education 1973a) 
Course structure . v* 

An essential feature of the pre-apprent iceship course in carpentry and joinery 
was that it was structured around a major work experience activity. At least 
half th% time of the course was spent in constructing a house which was 
subsequently sold to the Housing Commission. Each class in a college consisted 
of 16 students, but the construction was performed by groups of eight students 
working with an instructor. By this means it was planned to provide for the 
development of practical skills in a realistic working environment. As far as 
possible the work at the construction site was planned to resemble as closely 
♦ as possible the working conditions a young person in employment would 
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Table 3.2 Distribution of Pre-Apprenticeship Enxoli^nts Amon^ Various 
(NSW) Courses - ^97^ ^"^ ~ 



Course 



Enrolsaits 



Bricklaying 




S9 


Carpentry and Joinery 




314 


Woodworking Machinery 




9 


Furnishing Trades 




13 


Signwriting 


13 


Painting, Decorating § Signwriting 


• 12 


Floor S Wall Tiling 




14 


Painting § Decorating 




30 


F S H Welding 




119 


Metal Fabrication 




74 


Refrigeration Mechanics 




15 


Welding 




36 


F § M 




95 


Auto/Welding ^ 


# 


148 


Butchery 




39 


Cospercial Cookery 




12 


Bakery 




11 


Eiectrical/F § M 




55 


Electrical Trades 




72 


Radio ^ 




15 


Plimbing 




24 


Hairdressing 




50 


Auto/F S M 




76 


Auto Engineering 




109 


Panelbeating/Vehicie Painting 


42 


Panelbeating 




42 



Total 



1528 



Source:, Heller and Naylor (1978) 
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experience- The remaiT^cr of each student's tiise was spent in theory closely 

related to the construction tasks which were being done at that tise on the 

txiiiding site, \ 

♦ 

In the preaable to the 1973 syllabus it was stated that the course 
proposed was highly flexible and offered 'a unique opportunity for teachers 
to develop the concept of integrated teaching' (New South Wales Department of 
TAPE, 1973a)', The syllalms document suggested dividing the program into two 
strands: one based on the theory, drawing, geometry and calculations and 
the other on the workshop and site practice. Furthermore it suggested ways 
of inter-relating the two strands. A revised syllabus introduced in 1977 fpr 
both apprentices aiKi pre-apprentices provided for further integration of the 
subjects covering trade theory, trade calculations and trade drawing around 
24 major itass (e.g. roofing). In the 12 oonth pre-apprenticeship course 
students were expected to coaplete Stages I and II of the apprenticeship 
technicgij education cVurse (i.e. the first two years of CNlCfe) which 
included 17 of 24 topics. The topic organization and t^he flexibility also 
enabled the theory to » closely co-ordinated with the students' activities 
in the site work of the construction project, 

A further important feature of the program was that *Life' Oriented 
Studies', the liberal education component of the program, was able to be 
taken by one of the carpentry instructors, VLife Oriented Studies' has an 
open curriculum in which iruJividual teachers, and their students, choose 
the specific topics to be studied over fivs themes: the work of the .trade, 
the structure of the workforce, leisure and non-vocational activities, 
comnion negotiations and social requirements. Given ah open curriculum in 
,this component it was possible for some integration between liberal and 
vocational stiuiies to be realize. The content of these studies could be 
related to the industry in which the students would subsequently be employed. 
Even though this arrangement did not apply to Communications, it enabled a 
coherent structure to be developed for the whole program. V 

The ffiexibility in ^isetabling which was mentioned is in part 
necessitated by requirements of on-site construction which could be affected 
by such things as supplies of oaterials or bad weather. However some 
indication of the allocation of priorities can be gleaned from the schedule 
in Table 3.5, 
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Table 3.3 Allocation of Time in the Pre-Apprenticeship Carpentry and 
Joinery Ptt)gram. 



HA 



Subject 


Hours per week 


Theory/Drawing and Plan Interpretation 


7 


Workshop/Site Theory and Trade Practice 


20 


Trade Calculations 


2 


Lire Oriented Studies 


4 


CoBinuni cat ions and Self-Expression-1900D 


2 


Total 


35 


Note: This is based on 35 hours per week for 


36 weeks. 


Relationship to further courses of study 




It is intended that students after finishing th 


is course should complete 


their training through a normal apprenticeship. 


Exemptions from certain 



of the tenas of apprenticeship have been arranged by the inclusion of a clause 
in the apprenticeship award. It is possible for a party to apply to the 
Apprenticeship Committee for credit less than, or in excess of, the prescribed 
credit. 

The situation is further complicated in the case of students who have 
not been successful in all their final examinations, where individual 
negotiations occur, and for apprentices employed under Federal awards. 

Notwithstanding these complications successful completion of the '56 week 
pre-apprenticeship course in carpentry and joinery entitled a student to 18, 
months credit from the term of the apprenticeship* He would be paid at second 
year rates for the first six months followed by two years at third and fourth 
year rates respectively. In addition he would have only to complete Stage III 
of the technical education course on a day release basis. It was believed by 
many people we spoke to that the length of credit available was a deterrent 
to the employment of graduates of these .courses. Putt (1978) has reported in 
more detail on the actual exemptions obtained by pre-apprenticeship graduates* 

A new development 

At the commencement of ^1978 a 54 week, or 18 month, pre-apprenticeship program 
in carpentry and joinery was in4roduced on a pilot basis. This began in two 
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ways. One was the provision of a six month extension for students who had 
completed the 12 month course and had not been able to obtain eiaployxaent while 
the other was the provision of 54 week programs for sose beginning students.^ 
In such £| program students were .expected to complete the final stage (Stage III) 
of a technical course. The structure of site experience and instruction was 
siiaiiar to that in the 36 week program, &iccessful completion of this program 
was intended to entitle a student to 21 isonths remission from the term of 
apprenticeship. It is interesting to note that this development was in 
response to a proposal from the Master Builders Association to introduce 
complete full-time training for all building trades as a complement to the 
traditional apprenticeship system. 

An Office Training Pro-am 

fhe general context 

Courses intended to prepare young people for employment in offices have 
traditionally been conducted by a number of agencies: technical colleges, 
private business colleges, and some streams of secondary schools- In general, 
these courses are intended to lead directly to employment in office work. 
Even though it may be possible to undertake more advanced studies in 
secretarial practice, the courses with which this project is concerned are 
not primarily intended to be preparatory to those studies. There is no 
necessity to undertake further studies to complete basic qualifications in 
the occupation as was the case in the carpentry and joinery program discussed 
previously, 

In 1978 the Technical Education Branch of the Queensland Department of 
Education offered three pre-employment programs in this general area. Two 
were of six months duration. One of these was a 19 week course for training 
clerical assistants which required no s^peci^l conditions for entry. The 
second was a 19 week course known as Office Training A, which required for 
entry the achievement in the Junior School Certificate of at least three 
points in English, 4 points in typewriting and a shorthand standard of 70 
words per minute. A third course in this area was Office Training which 
was of 12 months duration and required no special entry standards^. In fact 
it is intended that students completing Office Training B should achieve a 
similar standard to those completing Office Training A, An indication of the 
relative importance of these programs can be gained from 1976 enrolment 
figures which show 99^ students in Office Training B, 405 students in Office 
Training A, and only II students in the Clerical Assistant Program. 
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Office Training B was offered at three metropolitan and eight non- 
metropolitan colleges in 197S. Even though the syllalms was similar at each 
college^ ther€ were important differences in course structure and teaching 
methods. In the present investigation, attention has been focused on the 
course in operation in one college which incorporates a numlter of important 
new features. The new features were sufficiently important to consider the 
program at the college as a distinct entity. 

The new program began in the latter part of 1976 admitting students who 
had partly completed the course at other colleges. It was staffed with 
teachers from those colleges who were enthusiastic about and volunteered to 
participate in the new program- In 1977 the first group to undertake the whole 
of Office Training B under the .new program was admitted* 

Course aiiss 

In describing the program there were two sets of aims or objectives to be 
considered. One set came from the syllabus document for the Office Training 
B, While described as objectives in that document (Queensland Department of 
cation, 1976) the statements listed simply described the course in general 
terms: 

1 This course is designed to provide skills in secretarial procedures 
and to develop the personal attributes nefcessary for persons wishing 
to pursue secretarial careers* I 

2 The course allows specialization in eithen stenographic skills or 
typing and clerical skills. ^ ^ 

A more explicit statement of aims and objectives was corntained in the 
curriculum documents of the particular program under review. The three aims 
were concerned with broad social and personal aspect-^ of the programs. 

1 To provide all students with education which Will make them responsible, 
competent and employable citizens. 

2 To provide a situation where students cai/ interact through a program 
which is flexible and which simulates an office environmnet. 

3 To provide an atmosphere of learning which will contribute to their 
total development as people. 

{Queensland Department of Education, 1977) 

The nine objectives which were listed were mixed. Some concerned the 
processes which were to be used in this program (e.g. allow for a variety of 
experiences, provide individualized instruction) while others concerned the 
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^ ebjoctives of the prograa with regard to sti«ient outcoaies* Tjtken as s group, 

• while the objectives are aixed, they do provide an indication of the 
. intentions of those who fraa^ tlw? program • . ^ 

1 To instruct students in shorthaiKi, typoitfritirig, office machines, 
English* secretarial practice and social training. 

2 To enable students to attain a high degree of proficiency in the office 
^ ^ c - skills undertaken by the®.* 

5 To enable students to accept that secretarial practice, English and 
office aachines are part of the total off ice' concept and not isolated 
subjects. ' ^ 

4 To provide cpntact with the business world through excursions, ^^est 
speakers and work experi^ce, 

5 To provide a course of study which allows for a variety of experiences, 
instruction, practice; re-enforcement, recapitulation and evaluation, 

6 To provide an atiaosphere where students learn to wrk with*-one another; 
.to assist one another; to \^rk on their own. 

7 To provide a progran of individualized instruction whicl> will enable 
students to progress according to their potential, and also incorporating 
remedial and/or advanced instruction. 

S To encourage student initiative, responsibility 3n4 sound >^rking habits. 

9 To develop student awareness of the coipmunity and the economy. 

As a result of interviews with those involved in developing the new program, 
it was apparent that* paramount wong their objectives was to enable students 
to be ready for employment. Readiness for employment was taken to include 
^ not only the development of necessary skills but also the^ student's gentjral 
approach to working in an office environment. 

Course structure 

As previously indicated, th^course provided for two alternative strands, one 
involving stenographic . studies and another involving tiyping and clerical 
skills. Students were able to choose the first alternative only if their 
performance on an aptitude test was satisfactory. The Iformai structure of 
each strand is shown in Table 3.4* ' 

In the original curriculum docuiBent -being considered for the program, 
there were four key elements in the teaching of that program- 
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Table 3.4 Formal Structure of Office Training B 



Alternative 1 




Alternative 2 V 

— - — _ Ns 




Subject 


Hours 
per week 


Subject 


Hours 

week 

^ — , 


, CoHercial English 


X 
4 


Comercial English 


6 


Secretarial Practice 


4 


Secretarial Practice 


S 


Typewriting 


7 


Typewriting 


' 10 


Social Training 


1 


Social Training 


1 


Business Machines 


•2 


Business Machines 


4 


Shorthand 


10 


Receptionist Practice 


1 


Private Study 


2 


Ofal Coinmunication 
Private Study 


1 
2 



1 Authentic practical application, ^, •> . 

2 Individual progression, . ' * 

3 Integrated subject work, 

4 Building and reinforcing a basic core of knowledge. 

A major feature of the first key ^element was an attempt to simulate a modern 
' office environment . Two .floors of a modern office building were leased and 
set out as modern open plan offices. Even though the course was conducted . 
in a centre which was administratively part of a technical college it had a 
separate physical identity. Also Important was the equipment provided which 
was as similar as, possible to that found in modern offices. In addition, the. 
tasks which students performed were designed to replicate the tasks which 
would be expedited of them in employment. As part of the yearns work, each 
student assembled an employment folder of samples of their work to present at 
an employment, interview,. Organizational matters were handled as might be 
expected in a modem pffice. Hours of work were set to match those of 
employment, reporting of absences were as^ for a person at work, and the general 
atmosphere was that of young pSople at work. - ^ 

The second key element, that of individual progression, involved the 
extensive use of self paced learning strategies with cassette tapes, work sheets, 
and mastfery tests. This approach to teaching was an important complement to 
the provision of simulated work experience. In ^ome ways the instructor was 
able to function as an office supervisor in each lesson^ correcting and advising 
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. studcmts who caae forward with questions rather th^n directly teaching. This 
approach was generally ad^ted within the framework of discrete one hour 
lessens, but the extent of using individual materials was considerable. Of 
course, the development of so»e skills such as typing at a satisfactory speed 
was achieved through group exercises. ^ 

The ranaining two elements, integration and reinforcement of core, 
knowledge^ ware partly the result of the teaching arrangements.- An important 
part of this was the fact that all the teachers were cosasitted only to this 
program and could co-ordinate their activities. The p;fogram operated on two 
separate floors each of which had its own group of teachers and one co- 
ordinator. As a consequence, there was good opportunitty for communication 
between the teachers. In addition, the work in each subject was structured 
to provide integration and reinforcaaent. Tasks in English would also 
involve typing and those in secretarial practice' would require both good , 
expression and good typing, 

By way of conclusion, it is worth reiterating that the aim of the program^ 
was to prepare young people for office employment and to use individual 
inst2:uctional materials. Consistent with this, many s^tudents left when they 
had mastered the work to an appropriate standard. They were not •obliged to 
remain for the rest of the year. ^ 

A Pol ytechnical 'Program . 

The general context ' , 

. When the Australian Apprenticeship Advisory Committee received a report of a 
working party on pre-apprent iceship training in 1976, it was noted such courses 
had not been provided in Queensland, Tasmania or the ACT (AAAC, 1976). In 
Queensland, there had been a pre-apprenticeship course in bricklaying for 56^ 
students which lasted for^20 weeks in 1974 (Hutchison, 1978), Subsequent a 
meeting of State and Commonwealth Ministers for Labour in 1976, a series of' 
pre-apprent iceship courses were commenced in' 1977. Details have been recorded 
^ in Table 3.5. .These programs were financially supported by the Comt!K)nwealth 
Government (Hutchison, 1978:50-53) and participants were eligible for 
allowances under the NEAT ^system or the Tertiary Hducation Assistance Scheme, 

In addition in 1977 a full^ime program for school leavers who wished 
to subsequently enter apprenticeship, or become skilled workers in trade areas, 
was started by the ^Queensland TAFI: authorities. This program was known as 
the Pre-Vocat ional (Trade-Based) Course. We have used the term 'pre^vocat ional 
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Table S*S Pro-Apprenticeship &a\g-ses in Queensland. 1977 



Trade Area • 



Duration PnroiBiftnt R^^wct^on in Stages in 
(weeks) Apprentice- App. course 

$hip(9onth$} coii|)leted 



Signwriting/Screen- 
processing 


' 14 


14 


12 


1/2 


Refrigeration Mechanics 


21 


14 


12 


1 and 2/3 


Cabinetaakitxg 


21 


28 


6 


1 and 2/3 


Carpentry and Joinery 


21 


28 


12 


1 and 2/3 


Bricklaying 


14 


28 


12 


1/2 



Source: Ibtchinson (1978:53) 



in a generic sense througWout this report. To avoid confusion, this 
particular program has been referred to as the polytechnical program since it 
encompasses a number of trades. In this respect, it could be seen as a 
response to a statement made in the reiK>rt of the Australian Apprenticeship 
Advisory Cpsaaittee *that future development might include" pre-vocational 
training providing a general introduction to a family of trades' (AAAC, 1976:46). 

The polytechnical progTam was offered in one metropolitan and two country 
colleges and extended over 35 weeks in both 1977 and 1978. Total enrolments 
in the program were 224 in 1977/ 112 being at the metropolitan college. In 
1978 the enrolments were similar. Compared to the total number of apprentices 
in Queensland which was 21,302 in 197?iVor even the 5495 new apprentices, the 
number of students in this program was small. However it should be noted 
that the program commenced on a pilot basis and was extended in 1979 to many 
more technical colleges. It is a significant program in terms of possible 
future developments. The Minister for Labour Relations in Queensland was 
reported as suggesting the introduction over the next five to 15 years of a 
system of training involving an introductory year of pre-vocational polytechnical 
training, leading to a trade specific pre-apprent iceship course, and 
culminating in a final' shorter period of indenture as an apprentice (The 
Telegraph, 18 April 1978^ pS). Indeed in the same statement it was envisaged 
that the apprenticeship system might give way to full-time training in 
colleges supplemented by a systematic program of work experience. 
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It can be noted that in 1979 it was offered at an increased nunber of 
colleges. Other similar programs concerned with different groups of 
trades have been developed. 
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Course i^ims 

The aiss of this program were expressed in a general objective and a series 
of specific object ivM* The general objective^as: 

ri To provide students wilh a full-ti»e educamonal prograwfie, prior to 
^eaployaent, which will develop a range of itaediately usable skills 
' ^^and knowledge and which will also develop an awareness of differing 
attitudes aiui values present in society. ^ 

^ (Queensland Department of Education/ 1978a) 

A series of specific objectives amplified this general aia. 
The course is intended to allow the student: 

1 To develop the basic skills, technical knowledge and understanding 
that constitute the prerequisites for subsequent industrial train- 
ing across the broad spectrum of trade-based occupations. 

2 The opportunity to progress to a specialized vocational education 
associated with the particular calling in which a student has 
displayed a particular aptitude and level of ability to successfully 
complete and which offers the opportunity for^^fu^ure eaploysent, 
advancement, security an^ personal satisfaction. 

3 An educational experience which is a useful uni^ |n the develop«ent 
of parsons who subsequently may not cheese to follow a technical 
vocation. " 

(An alternative to Grade 11 for s3Uidetifs who do not wish to under- 
take, tertiary studies.) 

4 A means of developing an interest in and makiJig an objective ♦choice 
\ of a particular occupation or a career. 

(Information on the nature aj^i extent, of work opportunities and 
requirements of various industrial occupations.) 

(Adequate student evaluation and counselling to ensure placements in 
an area of graining selected to sui^ the student *s level of ability.) 

5 To develop desirable personality traits, altitudes and work habits, 

(A means of bridging the gap between school and society.) 

* (Queensland Department of Education, 1978a*) 

As evident from the stated objectives, the program incorjKJrated the 
notion of developing general vocational skills^ broad educational development, 
and preparation for^an informed choice of occupation. In the area of 
vocational skills it was intended to develop basic skills and technical 
knowledge across a broad spectrum of tr^es but also to provide for gradual 
specialisation in a .paarticular trade. 



ERIC 



49 



5S 



Course structure 

To achieve the objectives set out above there were two broad groupings of 
studies within the curriculum: technical studies and general studied. 
General studies were taken over the whole 35 weeks of the course and 
encompassed the subjects communication skills (three hours per week designed 
to increase competence in reading, writing, spealfing and iisteni^ng), human 
relations (between two and three hours each week concerned with developing a 
student's maturity and an understanding of himself, his social environment, 
and his work environment), and human movement (four hours per week concerned 
with occupational safety, physical fitness and leisure). 

The course was divided into five modules each of seven weeks duration. 
Over the five modules there was gradual specialization in the technical 
studies as represented in Figure 3.1- 

The first three modules were general and encompassed' general skills in 
trades practice, drawing, calculations and science. At the beginning of the 
fourth module, students elected to study in either an engineering or 
construction semi-specialization. In this module there was some specializa- 
tion in the trades practices, drawing and sciences. For the final seven week 
module, students specialized in one of the five trade groups indicated and 
took all their technical studies in those groups. 

Within this structure were, contaiufi^several types of integration. 
Firstly, there was integration of skills common to groups of trades covered 
in the general and semi-specialist modules^ These wore specified in the 
syllabus (Queensland Department of Education, 197Sa) and represented a bold 
advance in thinking about trade training. This approach provided a start 
towards applying the notion of adaptable occupational skills discussed in the 
previous chapter. Secondly, there was integration between the general and 
technical studies, so that general studies were related to the industrial 
and social en\/ironment s in which students would work. Finally there was 
integration between theory and practice which occurred because the. course 
involved a core of teachers who were committed to it and a relatively small ■ 
group of students. However the course did not involve any systematic work 
experience or experience of full scale construction. 

Re lat ionship to furt her courses of study 

Even though the pel ytechn ica 1 pre-vocat ional program had rather broad aims 
it was j;^(^c loped with the intention that many of its graduates would enter 
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apprenticeships. Exeaptions from the conditioBs of a normal apprenticeship 
were not so extensive as for the pre-apprenticeship ccHirse in carpentry and 
joinery which have been described previously, A graduate of the polytechnical 
pre -vocational program was entitled to exemption from Stage I of the relevant 
apprenticeship course and a reduction of six nionths from 'the normal four 
years of an apprenticeship (Queensland pep*t4«aent of Education, 1978a). 

A new development 

The description above applied to the program offered in |978,^ After 
extensive reviews by the Curriculum and Evaluation Section of the Education 



module 1 
< ' 



module 2 
(4 ^ 



module 3 
(4 >t 



module 4 
< ^ 



Engineering 



General\ — General 



General 



module 5 



Electrical 
Radio 5 TV 



Fitting D 5 HEE 
Fitting § Turning 
Mechanics- Motor 

Cycle S Marine 
Motor Mechanics 



Boilermaking 
Sheetmetai 
Body Building 
Blacksmithing 



Construction 



Carp. S Join. 
Cabinetmaking 

Plumbing 

Wood machining 



Bricklaying 

Stoncniasonary 

Floor 5 Wall 
T i i ing 

Plastering 



' i gu r e 3.1 Pre -Vocat i on al (Trade Based) Cou r^c_ 

Source: Queensland Department of liducation, 1978a, 
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Department's Technical Education Branch the program was both aaeirfed and 
offered were widely in 1979. The main change was to provide for earlier 
specialization in the program. Three aodules of 14, 8, and 14 weeks duration 
were iaiclude4. The first of these was general, the second semi-socialized 
and the third spe|:iali2ed. The basic structure and intentions remalTn similar, 

A Full --Time Certificate Course in Chemistry 

Certificate courses in New South Wales and other states have been established 
for some time and provide .training of a semi-professional nature for intending 
technicians. In that state as elsewhere they have grown rapidly as employ- 
ment patterns in industry have changed. Until recently these courses in New 
South Wales have been undertaken by part-time study. Parallel with the 
introduction of full-time pre-employment courses in skill^ trades in 1973, ' 
a number of full-time pre-employment courses at certificate level were 
offered for the first time. They were intended to provide an 'opportunity 
for ifull-time vocational ^tudy for young people leaving school after Year 10 
(New South Wales, 1974). The first courses offered on this basis were ii/^ / 
electrical engineering, mechanical engineering, commerce, ami architectural^ ^ 
drafting. Two years fuU^-time study was involved after which a student I 
completed a third year of part-time study in combination with related ^^^A-^ 
employment. Subsequently other pre-employmeni certificate courses were 
offered. 

The introduction of prt-* employment certificate courses was. gt^ided by 
an expressed wish to provide greater diversity in post compulsory education, 
and smooth the transition from secondary schooling to work (New South Wales, 
1974), It was hoped to extend the range of vocationally oriented courses 
available to young people. The provision was seen as directed towards young 
people who were faced with the choice of pursuing a general school course 
out of line with their interests or leaving school to commence work at a leveji 
which gave little scope for future deveiopment . It was stated that tlie 
main purpose of the courses was to enable the achievement of vocational 
competence in middle level occupations. In its annual report for 1975 the 
New South Wales Department of Technical and Further Education noted an 
increased demand for full-time study which they attributed to the growth 
of unemployment in the community (New South Wales, 1976)- In particular 
it observed a notable growth of full-time enrolments in certificate courses. 

From the beginning of 1977 pre-employment certificate courses were 
replaced by full-time certificate courses. This rationalized the provision of 
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certificate level courses^ as the full-time provision led to the sase award, 
had the same entrance requirement, and most subjects were the same as for the 
{>art-tiBe courses. However, the full-time cotirses were %o include some 
additional subjects to compensate for the lack of work experience and soaie 
liberal st^ies subjects (New South Wales Department of Technical and 
Further Education, 1977a). For the purpose of this project it is important 
to note that the provision of full-time certificate courses in New South 
Wales grew out of pre-employrnent certificate courses. 

The certificate course in chemistry was of interest for several reasons. 
Firstly, it was *a course which provided a general training for a range of 
scientific ocdupations. Secondly, there were similar numbers of male and 
female students in the course. Finally it was a course which had attracted 
a steady enroliaent over a number of years. Part-time enrolments >iad been 
ranged from 635 to 682 over the years 1977 to 1978 while fuH-tisje enrolments 
in 1977 and 1978 were 59 and \^ respectively. 

Course aims ^ 

The aim of this course as stated in the syllabus was both specific and 
vocationally oriented, 

^o educate students in the basic aspects of cheisistry, chemical 
technology and associated subjects, in order to achieve the standard 
^ of competence exfiected of the chemical technician in such areas as 
production, quality control, research and development and technical 
service. 

(New South Wales Department of TAPE, 1977b)^ 

C o ur s e structure 

The course was structured around four stages which could be taken full or 
part-time in a number of combinations. 

(a) All stages part-time; OR 

(b) Stages I and II full -time in one year followed by Stages 111 
and IV part-time; OR 

(c) Stages I and II full-time in one year followed by Stages III 
and IV fuil-tjme in one year; OR 

(d) Stages I and II part-time followed by Stages III and IV 
full-time in one year, 

^ The subjects involved in the course and the time allocated to them 
for both full-time and part-time students is shown in Table 3.6, It* 
can be seen that the total teachin^i time in most subjects was greater for 
full-time students. Additional practical work occupied most of the extra 
time and'was included to compensate for the students lack of industrial 
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Table 3.6 Structure of the Chemistry Certificate Course 



Part<"ti»e 



Full-time 



Stage 



Subjeojt 
J 


Yr 


Hours 
per 


Total 


Yr 


Hours 

per 

week 




Total 
hours 


Practical Chemistry 


1 


2 


72 


1 


8 (wks 


: 1-12) 


96 


Chemistry 1 




$ 


108 




9 C 


1-18) 


162 


Mathematics 1 




ih 


54 




4 C 


1-18) 


72 


Physics 




3 


inn 




% 
J 






Laboratory Technique 1 


2 


4 


144 


1 


8 ( 


13-36) 


144 


Chemistry 2 




2 


72 




9 C 


19-36) 


162 


Ma:thematic5 2 




Us 


S4 




4 C 


19-36) 


72 


Tech. Comunication 




2 


72 




4 




144 


laboratory Technical 2 


3 


4 


144 


2 


12 C 


1-18) 


216 


Analytical Chemistry 1 




155 


54 




4 ( ' 


1-18) 


72 


Organic Chemistry 1 




1% 


54 




4 C 


1-18) 


72 


Unit Operations 




1 


36 




3 C 


1-18) 


54 


Annlifid Physical Chemist rv 




2 


72 




5 C 


1-18) 


90 


Advanced Technic^ 


4 


72 


2 


6 C 


19-36) 


108 


Analytical Chemistry 2 

< 


1 




72 - 




6 ( 


19-36) 


108 


Organic Chemistry 2 




2 


72 ■ 




6 ( 


19-36) 


108 


Industrial Cl^mistry . 

The Austral i^an ^ 
Chemical industry 




3 

■ 1 ■ 


108 
36, 


and 


8 C 

2Hi 
4h( 


19-36) 

T-TS) 
19-36) 


144 
126 



r 

TDTAL hours 



For full-time students this includes Liberal Studies 



For full-time students this extends ov^r two semesters. 
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experience. An. iaportant issue raised by this program was the extent to 
which it has been possible to cospensate for this lack of industrial 
experience in a vocational program. 

The Four Programs in Retrospect 

/ / 

The four pr^^asas described in this chapter have been concerned with 
different oqrcupational fields. In addition the course structures were quite 
different. Vet there were ®any similar clients involved in the programs. 
All were concerned with the transition of young p^pie from school to work. 
^Each attempted to provide a vocational education which was concerned with 
the broad development of an individual as w^ll as with occupational skills. 
In most of the programs there was a concern with adaptable CK:cupational 
skills rather than those skills confined to a particular job. Above all 
in each program there was af. attempt to compensate f^r the lack of work * 
experience of these student^. These programs represented specific responses 
to the general issues discussed in Chapter Two. 
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EVALUATION 



Evaluation occurs frequently as teac^rs sake judgaents abckit a variety of 
I aspects of their job. Such evaluation usually involves gathering evidence' 
by observation and weighing this evidence to produce some judgiaents about 
the appropriateness of a particular educational prograa or teaching method, 
Inforaal evaluation of this sort ©ay often "involve unsystematic gathering of 
^idence and judgments reached quite uncoaeciously. This report is concerned 
with a »re formal approach to evaluation intended to provide reliable evidence 
to assist in the makii^ of sou^^^^isions about* pre -vocational education. 
Recent developments in the evaluation of educatidnal and social programs are 
particularly useful in understanding how a syst^tic examination of evidence 
can lead to jixdgments about curricula in general, and pre -vocational programs 
inparticular. The first part of this chapter will exaaine those developments 
^Hpare saost relevant to the evaluation of pre -vocational education. 

The Purpose and Role\ . of Evaluation 

Evaluation is a widely used tenc which refers to a form of policy research. 
Its, purpose is the appraisal of a prograa by means of systematic research. 
One well known definition of evaluation susis up the purpose of evaluation. 

Educational evaluation is the prcu:ess of delineating, obtaining 
and providing useful infonaation for judging decision alternatives. 

1^ (Stufflebeais et al 1971:40) 

Within this definition are contained the twin puifposes of taking decisions 
and reaching judgments. In a subsequent article Stufflebeaa (1975) categorized 
the purposes of evaluation as either pro-active, through serving decision 
making, or retro-active in that it was concerned with accountability/ This 
distinction is similar to that made .by Scriven (1967) who identified two 
distinguishable roles of evaluation: a formativ^ and a summative role. The 
foricative role referred to the gathering of data upon which decisions 'could 
be made to improve a prograsj or T^uce Its deficiencies. Formative evaluation 
would thus be conducted in conjunction with program development. Information 
from such an evaluation would be intended for use by those concerned with the 
operation of the program. 

By contrast the summative role of evaluation referred to the use of 
evaluation in making judgments al^ut the worth of completed programs. 
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laaediate improvement of the program under scrutiny would not normally arise 
from a summative evaluation. Rather^" such an evaliiation would attempt to., 
determine whether a program had been worthwhile. The results of a summative 
evaluation might guide a decision about introducing a similar program in 
another cont&xt. In contrast to a formative evaluatibn the results pf a 
summative evaluati|p;i wcmld be destined for use outside the program. The 
benefits of summative evaluation are mre likely to' be long-term than short- 
term, though Scriven (1967) includes under summative evaluation the comparison 
of competing curricula perhaps with a view to choosing one for implementation. • 

It would be mistaken to view these roles of evaluation as mutually 
exclusive. Stake (1976) has argued that the distinction between formative 
and summative evaluation is seldom clear. One reason is that a program may 
contain various components such that what is summative for one component was 
likely to be ^formative for the total program. Consequently, it seems likely 
that any comprehensive evaluation of a pre-vocat ional education program will 
incorporate both summative and formative issues. In such an area it is 
important to reach Judgments about the programs and provide information for 
their subsequent development. 

In brief, the purpo^ of an evaluation refers to the decisions, 
or judgments, to be made about the program while the role of an evaluation 
relates it to the continued development of the program. A consideration of ^ 
both of these aspects of an evaluation i^ important in ileveloping an 
appropriate methodology. 

The Scope of Hvaluation 

V 

Evaluation may be conceived as having a narrow or broad scope. As evaluatipn 
has become more directed towards j)rogram3^ with complex origins and multiple 
purposes its scope has broadened. In an attempt to describe this broadening, 
Glass (1972) has referred to two generations of evaluation models. The first 
generat ioniums ch^iracterized by its predominant concern with determining 
whether a program had achieved its stated goals or objectives. In brief, the 
scope was narrow. Often this approach involved the translation of goals into 
behavioural objectives and using tests to assess student achievement of those 
objectives. Among others, Scriven (1967) was critical of such an approach on 
the basis that other aspects of the program, such as the goals themselves, 
were not evaluated. The approaches to evaluation which Glass considered part 
of the second generation of curriculum evaluation models embo^iied a more. 
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cojBprehen&ive approach to the evaluation of curricula. In briefs the?e 
approaches viewed the programs under review as 'systems comprising a nuuaber of 
coaponents. Though student achievement was not to be neglected i\ was 
considered as only one component of the total systeia. 

One important aspect of the broader approach to evaluation described 
above was the seeking of more extensive inforaation about the processes and 
products of the program under review. Information beyond that describing the 
achievement of goals is usually needed for planning purposes and is important 
for educational decisions. In the absence of systematic evidence about what 
jias been taught, how it has been taught, and student re'^tion to such teaching^ 
decisions about future developments would be arbitrary. 

Another aspect of the second generation evaluation mihiels concerns the 
programs with which they were concerned. Many of the curricula for which they 
were developed were concerned as jjych with bringing about ch^ges in teaching 
processes as with increased student achievement. An adequate Vvalus^t ion of 
such curricula needed to encompass the process goals. In the pre-vofcat ional 
education programs described in Chapter ^Three there was an intent ionUo provide . 
for students some of the experiences of work. The extent to which this was ^ 
achieved seemed an important part of the evaluation, \ 

The area of pre-yocational education had similar characteristics^^ to 
those in which the broad approaches to evaluation had evolved. For this 
reason the approaches to evaluation which were "broad in scope provided a more 
appropriate -guide than those in which the scope was narrow. 

i 

The Elements of an 'Evaluation ' 

A key issue which arises in ^ broad approach to evaluation is that of the ^ 
definition- of the essential elements on which attention should be focused. 
It has already indicated that something more than the extent to which a single 
goal has been achieved would be required. For an evaluation to be' systematic 
it would be necessary to operate within a frainework o# component elements. 

One way in which the component elements of the evaluation of an 
educational program have been defined is by reference to the ty^^e of liecision 
which they serve, Stufflebeam £t_ al_, (1971) identified -four types of educational 
decision: planning decisions to specify objectives, structuring decisions 
concerned with the means to the objectives, implementing decisions and 
recycling decisions. Corresponding to these types of decision were four forms 
of evaluation. ' S 
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^ ^Q^^gxt evaluation ealjpdie^Saii 4itt«Bpt to exasine the rationale for 
the objectives^ It involved \ consideration of problems in the 

educational setting and utiL«ed aainly descriptive methods* 

- . 

^ ^^P^^ evaluation was concerned with an analysis of the ways existing 
resources could be utiliz^ed to achieve goals and of the additional 
\^ resources which might be required for the program. 

3 Process evaluation was direct^ to monitoring the implementation of a 
program^ and in particular, to examining the actual instructional 
procedures which. were used when the program was taught, 

4 Product evaluation was concertied witfi the assessment of the attainments 
resulting from a program in relation to its objectives. This aspect of 
the approach was TOSt similar to the traditional gbnception of evaluation. 

The process of evaluation was envisaged as delinMlrr^ the infoTiaation 
required for a particular decisipn, obtaining that information by the collection 
and analysis of appropriate evidence, ai^ providing concliisions in a fofm 
useful to those who ^re required to make a decision. 

In addition to defining four types of decision, the settings in which 
decisions were taken were considered to be an important influence upon the 
way evidence would be gathered ^nd analyzed. S^e decisions would be made 
in a setting where the prime concern was the maintenance of an existing system; 
others would be taken with a view to making small improwments to an existing 
system, a few VKJuld concern innovative attempts to solvfe significant problems, 
and^ finally some would concerned with Utopian activity directed to radical 
changes in an educational enterprise. Stufflebeam et al. (1971) argued that 
different types of evidence would be appropriate, or admissible in di'fferent 
settings. For example, in a setting concerned Svith maintenance ^OsLjn existing 
system, evidence concerned with monitoring perfcfrmance of students would be 
appropriate. By contrast, in a setting concerned with innovation, evaluation 
would be more concerned with the processes involved in classrooms. However, 
one of the problem's associated with applying this classification is that it 
is sometimes difficult to classify programs. Pre-vocational education could 
either be considered to be a large innovative setting, or a setting concerned 
with small improvements in an existing program. The basis for n^^king such 
a decision is ^ar from clear. 

Taken together, the' four types of evaluation described above constitute 
, a framework which has some value for the continuous evaluation of new programs, 
such as pre-vocational education in Technical and I^rt her- Education • In fact. 
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the appxroich his formed the basis of the TOnitoriug qf the introduction of 
Pre-VocationaJ (Trades Based} Courses by the Technical Education Branch of the 
Queeaslatui Education Departaent C197Sb) . As the new course was introduced a 
ccHitinuing foraitive evalyation was -cojKiucted which involved ail four types 
of evaluation being undertaken progressively*. 

Because it was developed with a view to assisting in the making of 
decisions, this approach is closely relat^'to the type of decision being made. 
As a consequence it has been expressed in terms more appropriate for examining 
a program as it is introduced than for an extant program. Even though 
subsequent articfes (Stuff lebeam, 1975) have argued* that the scheme could 
' guide an valuation concerned with accountability, the emphasis appears to 
have been upon forming decisions. For tihis reason it seisms that its value 
as an evaluation scheme ^ou^^i^^ greatest f<5V those programs in Technical 
and Further Education which were being monitored, as they were introduced. 

As 'a resul"5 of this approach to evaluation being based on the type of 
decision to be made, the elements defined are elements of the evaltiation 
rather than elements of the curricuiuia to be evaluated- In the evaluation 
of an existing program it would seem better to base an evaluation on defined 
elements of the curriculum than on components of the decision making process. 

An approach to the study of curricula which was similar to that of 
Stufflebeam, but was more directed to the elements of the curriculum, was that 
proposed by Dahllof (1971). . 

* Dahllof proposed that outcomes could be regarded as a function of three 

-other elements of the curricuiuia: objectives, fra^e factors and processes. 
Frame factors were those institutional features which might affect learning 
such as»class size, teacher qualifications. "^As presented these elements were 
related to outcomes in a simple linear fashion. Even though they seen best 
considered as part of an interactive system, they do provide a useful basis 
for the substantive part of an evaluation. The. four elements wete considered 
to be embedded in the context of social, environmental and manpower demands. 

Some simiiaritias exist between the elements^of the Ssftriculum described 
by Dahllof C197f^ and the ^four types of evaluation formulated by Stufflebeam 
(1971). lliere appears to be a correspondence between outcoiJias in the Dahllof 
approach and the product evaluation of Stufflebeam.. Processes were mentioned 
by both. Frame factors, as described by Dahllof, would be included in the 
input evaluation proposed by Stufflebeam, A context evaluation would concern 
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itself with course objectives and the social and economic setting of the 

prograjB, , 
# 

A further proposal regarding the elements of a curriculum which ought 
to be considered/4'n evaluation was that of Stake (1967). Three bodies of 
■ information were considered to be important components of any curriculum, 

i Antecedents which were considered to be conditions existing prior to 

instruction which might affect student outcpmes (e.g. student background 
characteristics, class size, resources etc.)* 

• 2 Transactions which could loosely be regarded as teaching processes 
and othftr curriculum related activities, 

3 Outcomes were considered to be the effects of the program including 

among other things student achievement iii relation to the program goals, 

A Finally it was indicated that an evaluation should include an exami,nstion 

of the rationale for the program. Even if it is only implicit the rationale* 
indicates the philosophy, background and purposes of the program.- Chapter 
Two of this report cdntains an analysis of the rationale for pre-vocat ional 
education- ^ 

The similarity between transactions and outcomes in this approach, ar^d- 
processes and products in the previous discussion is apparent. Antecedents 
is a category which included those aspects of a program which were designated* 
frame factors by Dahllof (1971) but which is broader. It incorporates 
student background characteristics and tea(^er characteristics, two important 
factors which did not fit readily in the Dahllof approach. In a recent 
publication the Curriculum Development Centre (1976) has combined the proposals 
of Stake (1967) with those of Jansen £t_ a^- (1972) to suggest thaf 
antecedents are made up of b^ickground characteristics and stable contextual 
factors. Goals were not omitted^ from Stake's suggested framework. They 
W9re included in two places: in the rationale for the program and in the 
* intents related to antecedents, transactions and outcomes. In both the 

rationale and the intents an attempt v/as made to encompas^^oal s broader thhn 
specific objectives. ^ 

In thesq a^^proac^l^e^ to curriculum evaluation there appear to be a number 
of common features. While the elements of a curriculum which were considered 
to be important facets of an evaluation were not identical in each approach 
there was consideratfle 'similarity. As a consequence it seems reasonable to 
suggest the important elements with which an evaluation in - pre -vocat ional 
education 5?^iould be concerned. 
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' 1 TheV^tionale and goals of tiie prograsL (including ^ consideration of the 
socia\ and econoaic factors leading to the establishment of the pro grain) . 



2 , Antecedents telQvant to the program, 

3 Transactions, or teaching processes. • 

4 Outcosies, , • " ■ . 

Methods of Gathering Evidence 

Recent emphasis on the evalixation of wide ranging social and educational programs 
has had repercussions on the breadth of evidence collected- In general^ the 
evidence now admitted in evaluation stupes is broader than was the case a 
decade ago. Some of this broadening ^has resulted from a concern to attend to* 
the evaluation of processes as discussed earlier,. One development w^s to make 
greater use of observational data within the framework of flexible research 
designs, and thus allow unanticipated events to be taken into account 
(Stenhouse, 1975:113). Nevertheless there are evaluators who still a^gue for 
rigorous quantitative methods of data collection within the framework of tight 
designs (Cooley and L(^nes, 1976). - 

Though the varied approaches to the gathering of e^dence are sometimes 
seen as conflicting we contend that they should be regarded as complementary. 
For example, questionnaire and survey methods of determining student 
perceptions of classroom process complement structured and unstructured 
observation techniques, in the , study of classroom processes. Different methods 
of gathering evidence. should be used to provide information about different 
facets of U program and different perspectives on any given facet of a 
program. If different methods provide compatible information Jihe' val idity of 
any conclusion will be enhanced. If the information obtained by different 
methods is not consistent then further investigations "should be undertaken to 
try to discover the reason for the discrepancy. In either case something 
^ valuable about^ the program will have been identified for sometimes it is 
useful to know that different methods of enquiry yield different results,} 

< The Management of^ Hvidencc— 

■» , » 

As part of an evkluation it is nece^sai^y to establish a framework within 

which the evidence which has been collected can be organized prior to analysis, . 

This process does not refer to the technical aspects of data analysis but 

the prior organization of evidence in a framework. One framework for this 
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process which would be appropriate to the evaluation of pre-vocational education 
is, that proposed by Stake (1967), 

Stake (1967) argued that two major activities were essential to evaluation: 
description and judgment . Description concerned not only such things as 
student background characteristics and past achievement but the description of 
instruction and the relationship between the type of instruction and outcomes. 
Judgments involved comparisons between various aspects of a program and a 
set of standards. ^ 

The objects of description were the three elements previously discussed: 
antecedents, transactions and outcomes. Description of these elaaents involved 
what was intended, or the goals of the program in relation toeach element and 
ovservations, or what actually happened in the program. From ^hese cohsiderations 
three types of analysis were suggested, 

1 An examination of the congruence between intentions and observations 
regarding antecedents, transactions, and outcomes. 

2 An examination of the logical contingencies, or relationships between 
the intended antecedents, transactions, and outcomes. 

3 An examination of the actual, or CT^pirical, contingencies between the 
observed antecedents, transactions, ai^ outcomes. 

Thus the framework for description was s comprehensive one going beyond 
the collection of descriptive information about individual elements. Though 
it was descriptive of the program it was concerned with the relationships 
between the element^- in a program. 

Judgment was concerned with conclusions about the prograsi in relation 
to an external* standard. It was argued that judgments could involve not only 
outcomes but also transactions and antecedents. P^urthermore , two bases for 

*■ 

reaching judgments w^re described, 

1 Judgments involving relative comparisons between the program under ^ 
review and an alternative to it , 

I 

2 Judgments involving absolute compari^^ons between the program and a 
defined standard of excellence. 

Hence it is possible to set criteria for judging programs which are 
appropriate for the type of decision which is to be made. These two approaches 
to judgments in evaluation are analogous to the congepts of 'norm referenced' 
and ^criterion referenced* tests in the assessment of student performance. 
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The issue of; comparative ai^ absolute judgment in curriculum evaluation has 
been extensively debated in the literature. CronbacTi (1963) has ^gued 
that comparative judgment is inappropriate in evaluation research^because 
of the confounding effects^ of intra ami inter-class variability and the 
inability to randiMly assign subjects to treatments. On the other hand 
Anderson (1969) has contended that, in spite of the technical difficulties 
involved, comparative ju4|mei¥t can provide much valuable information for 
people making decisions. It would seem that comparative judgments are an 
important part of evaluation in those fields where it is hard to establish 
absolute standards, fhre-vocational education is such a field. 

^k^ltiple Criteria 

In previous sections of this chapter attention has been drawn to" the broad 
concepts of evaluation which abound. Different roles for evaluaticSn are now 
recognixod, attention is focused on other aspects of programs than measurable 
outcomes, and a variety of sources of evidence are recognized as admissible. 
However, even if attention were restricted to the evaluation of program 
outcomes it would be apparent that there were sailtiple criteria for the 
evaluation of most educational and social programs. This results from the 
breadth of the goals of many of the programs which have been evaluated. From 
the discussion in Chapter Two it is clear that pre-vocational education in 
Technical and Further Education is directed towards a number of goals. 

Many programs are designed to achieve both short-term and long-term goals. 
Suchman (1971) argued for distinguishing iimnediate, intermediate, and ultimate 
goals. This provides a useful way of considering the expected impact, of a 
program over an extended period of time. It carries the implication that to 
Judge a program on the basis of one single immediate outcome would be inadequate. 
From the rationale for pre-vocational education it was apparent that iimnediate, 
intermediate, and ultimate goals were invoi^d. Therefore programs in this 
field could not be evaluated properly on the basis of one immediate outcome. 

Irrespective of t'he time dimension many educational programs, and certaifily 
those in the pre-vocational field, incorporate several goals. In this 
circujiistance an important problem is to determine how much emphasis should be 
placed on each goal in the evaluation of the program. One recent article 
(Edwards, Guttentag and Snapper (1977)) indicates that decisions are' based 
on 'stakes' as well as *odds»„ It was argued that an evaluation needed to 
provide information about how highly valued is a given goal as well as an 
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indication of the probability that the goal had been achiev^. It follQws 
that the partial achievement of a highly valued goal may deserve greater, 
consideration than the complete achievement of a relatively trivial goal. ^ 

Significance and Probability 

A traditional practice in educational research and evaluation has been to refer 
to the statistical significance of a result. In the terms defined previously 
in this chapter this could involve either description or judgment. In 
judgiaent it could refer to the significance of a difference in scores on sowe 
outcome measure: either between an experimental and control- group, or between 
one group and a reference standard. In the description of contingencies it 
could be used; to test whether a correlation or regression coefficient is 
significantly different from zero, Much^ducational research adopts an 
arbitrary level of significance for accepting a result. Commonly, a result 
is accepted when thj9^^^iibability that it occurred by chance is less than five 
in one hundred C.05.X^ Such a criterion is believed to balance the chance of 
rejecting a valid proposition (a type 1 error) against the chance of accepting 
an invalid proposition (a type 2 error). ^ 

Among the practical difficulties associated with the interpretation of 
quoted significance levels are those associated with sample size. Relatively 
few educational studies make use of a power test to guide the choice of sample 
size and define acceptable levels of significance. Consequently in studies 
with small samples substantial differences, or correlation coef f li:ient s, can 
be reported as statistically non-significant. Conversely, with very large 
samples cdmparativeiy trivial differences ciTn be reported as statistically 
significant/ For this reason Cronbach (1975) has been critical of arbitrary 
significance testing. Like Carver (1978), who has identified other mis- 
conceptions about significance testing, he argued for reporting the size 6T~ 
effects, whether significant or not. Carver also recommended that proponents 
"^f significance testing should calculate t^he^^wer of their tests: a 
recommendation reinforced by Cronbach ancT^Snow (IS^^)- a further illustration 
of the complexity of the problem Ross (1976) has shown that for a complex sample 
design the effective sample size needs to be estimated before probabilities 
can be calculated. 

The choice of an acceptable level of significance is even more crucial 
in evaluation studies than in research studies. An argument for the use of 
the five per cent and one per cent levels in research studies has been that it 
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serves to guard against accepting false hypotheses as true. This caution may 
be appropriate when generalizations are being formulated, but the context is 
different for evaluation studies. In evaluation the policy consequences of 
rejecting a true proposition cannot necessarily by considered to be less 
profound than those of accepting a false proposition. For this reason th|2 
determination of an appropriate level of probability for statistical 
significance is important. 

Consider as an example the issue associated with the job satisfaction of 
graduates of pre-vocat ional courses intended to lead to apprenticeship. In 
particular, consider the question of whether job satisfaction differ^ between 
those who are apprenticed arid those who are not. Some results obtained from 
a small sample of students have been reported in Table 4,1, It can be noted 
that the probability associated with the difference between the two means is 
eight per cent. Such a result would be rejected as not significant ^t the , 
five per cent level in conventional terms, even though the difference between 
the means was about half a standard deviation. \ 

An alternative approach to the problem of appropriate significance levels 

has been outlined by Nagel and Neef (1977), They indicated how \in optimum 

level of significance might be reached by balancing the costs of a type one 

error against those of a type two error, A form of decision theory provided 

a basis for this approach. Given a clearly stated proposition it is possible 

to develop a four ceil matrix based on the proposition being true or false in 

combination with its acceptance or rejection. Acceptance of a true proposition 

and rejection of false proposition would be desirable outcomes. Rejection 

of a true proposition or acceptance of a false proposition would be undesirable 

The approach required the assignment of quantitative values to relative 

undesirability of the two which are undesirable. One might assign a value 

of -A and the pther -B if the former were A/B tinies more undesirable. Oncer 

such an assigm^ent had been made positive values could be assigned to the other 

> 

outcomes on the basis that they should mirror the first two assignments of 
valye (i.e. +A and +B) , Nagel and Ncef then showed that the probability for 
rejectiojf of the proposition, which was consistent with the previous assignment 
of value, could be calculated as 

p - A/(A^B). 

On this basis it can be shown that the acceptance pf a probability level of 
.05 xBiplies that a type one error (wrong rejection of the null Hypothesis] is 
nineteen times more undesirable than a type two error (wrong acceptance of 
the null hypothesis). In many evaluation studies such a view would not he 
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Table 4«1 Mean Scores on Job Description Index for Gradu a tfeof Courses 
Leading to Apprenticeship " ——p^ 

Mean Standard Deviation >jumber of Cases 
Gained apprenticeship 144.57 
Not appr^ticed 127.16 
Total 137.82 
F « 3.301. P « .08. 

consciously endorsed . For this reason careful thcHight needs to be given 
before accepting arbitrary levels of significance in evaluation studies, 

Conaider again the exaiaple of job satisfaction asK>n£ graduates of pre- 
vocational programs. Expressed explicitly, the proposition being investigated 
is that graduates of those courses who gain apprenticeships experience greater 
^satisfaction at work than those who do not gain apprenticeships. The validity 
of that prop9sition would have important implications for policy regarding 
career counselling and job placement assistance.* Two issues which might affect 
judgment about this propositioi^ would be the extent to which job satisfaction 
aawng young workers is valued and the cost of helping .such people to obtain 
apprenticeships. Suppose that on this basis false acceptance was considered 
more ul^sirable than false rejection, but that, the former was only fiv^ times 
more undesirable las the latter. Notice that this is still an essentially 
conservative stance. Under those assumptions the values of -100 and -20 
would be assigned to each of the errors. Thus the probability for accepting 
the proposition would be 

p - 20/(20+100) « 0.17. 

Hence, given the assumptions stated, the difference in job satisfaction between 
apprentices and non-apprentices would be significant for policy formulation. 

The assumptions made in the example above were based on our subjective 
opinion. They were stat^ for illustrative purposes only. Nevertheless, 
it may also be arbitrary to assume that false acceptance is 19 times more 
undesirable than false rejection. The virtue of this approach to 
significance in evaluation is that it forces one to make explicit asj^umptions 
which would otherwise be concealed. 



^0.03 ^^ 30 
36,55 19 
33.46 49 
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It is possible that approaches similar to this will become more general 
in educational evaluation in the future. In the case of pre-vocational 
education it would be inappropriate to use arbitrary significance levels in 
interpreting the results of evaluation. Rather, d more detailed consideration 
of appropriate probabilities would be a loore appropriate means of considering 
results. In addition, it should be recognized thit the participants in 
programs need to be involved in the process of allocating values to different 
types>^f error. Subsequent chapters indicate some first attempts to 
ascertaiV the priorities of different participants with regard to the multi- 
farious go^tls of pre-vocat ional education. 

Studies of Pre-Vocat ional Education 

« 

As a consideration additipnal to the general features of evaluation discussed 
in the previous sections of this chapter it is worth mentioning some specific 
aspects of rese^irch and evaluation in pre-vocational education. AnKJng studies 
conducted in this area attention has been given to important issues, general 
frameworks, and relevant techniques of gathering data/ 

» 

Issues in pre-vocat ional education 

Kaufman (1971) discussed several important issues involved in evaluating 
occupational programs in Canadian schools. Occupational programs in that 
coitH^xt can be considered as approximately equivalent -to the pre-vocat ional 
programs described in Chapter Three. One of the fundamental issues she raised 
was the disagreement which existed about the priorities of vocational courses. 
Most vocational coursfs contain goals concerned with general citizenship, or 
personal and social development in addition to goals concerned with skill 
training. Kaufman suggested that it was not possible to f-iiet ermine the extent 
to which these goals are in conflict. However, it does seem important 
to attempt to determine the different priorities allocated to the multiple goals 
of a program by different groups of people, ^ 

An additional jxpint raised by Kaufman concerns the difficulty of 
determining indicators of a program's succ^^ss. It is unclear what level of 
performance i-s expected of students since background characteristics often 
differ from those in comparable programs, and are' strongly associated with 
their attainment. This makes difficult the choice of standards against which 
to judge a program.; I-vcn rat e^ of employment would provide a dubious indicator 
of the quality of al vocational program because it is subject to so many other 
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influences: general ^ployment opportunities in tJ^e region, variatioiJ in the 
qualifications set for different Jobs, and the arbitrary nature of the criteria 
used for eaploywnt selection. 

Criteria of effectiveness 

A series of studies reported by Freeberg (1969, 1974, 1976) has been concerned 
with various aspects of training programs for youth in the United States. 
Some studies have concerned the developnent of measures which predict the 
ejaployroent success of those enrolled in the programs (Freeberg and Reilly, 1971). 
Other studies have. concerned more directly the development of criterion measures 
for the programs themselves (Freeberg; 1976). The programs which were examined 
by Freeberg were geiiferally directed to a group who were more socially dis- 
advantaged than students in pre-vocational programs in Australia. In additioti, 
the social context in which the programs were conducted differed vastly frm 
^ Australia. Nevertheless, it is possible to infer from the results Freeberg 
has reported, a number of dimensions which are likely 'to be Useful in 
evaluating this type of program, 

Ai^ng the criteria for examining the immediate impact of vocational 
programs which appeared relevant to the present study were: \ 

; 1 st^udents' proficiency as rated by others (this can be taken to inclAide 
both technical knowledge and practical skills), 

2 students* self -concept or self-confidence, " * 

3 positive work orientation, and 

4 attitude to further training and achievement. 

Freeberg (1976) was also concerned with assessing the longer term impact 
of programs. In "looking at the longer term impact of pre-vocational education, 
four criteria which are a little different from those advanced by Freeberg, 
seem appropriate: 

1 The rate of employment, ^ 

\ . * ■ 

2 Job stability, 

3 Job satisfaction, and 

4 Success in further study. 

I 

♦ In drawing attention to the need to examine both immediate and long term 

outcomes of work preparation programs, and in examining multiple criteria at 
each level of impact, Freeberg was applying in this specific context, ideas 
which were developing in the general field of evaluation. 

Q 70 

ERJC ?S 



Methods X 

One of the most common methods used in the evaluation of courses similar to 
those exauiined in this report has been to fallow up past graduates of these 
courses, Isabelle and Lokan (1973) have argued the merits of the follow-up 
study as a means of gathering evidence about a program's effectiveness. At the 
very least such a study can provide descriptive information about the nature 
of the jobs students have' entered, how easily they hate obtained them, their * 
job intentions, and their satisfaction in work. This information, in addition 
to the perceptions of their course, could provide valuable information for 
• course planjiers. The follow-up study was conducted by means of questionnaire 
•supplemented by personal interview ef both the student and their employer. ^ 
Similar follow-up ^tudies using this general range of methods have been 

reported by McGowtin, Mongerson and Carter (1971), i 

i 

In a review of program evaluation in vocational education, which was 

mainly concerned with the United States and Canada, McKinney (1977) oiscussed 

! 

a range of methods- used in evaluation studies. McKinney argued that la follow- 
up study should be directed to those who did not complete the course |of study 
as well as those who did succeed, Wentling and Lawson (1975) providei|d 
considerable information about conducting a questionnaire study through the 
use t^f successive reminders- Another study (Heberlien and Baumgartner, 1978), 
though not directly concerned with pre-vocat ional education, has detaijled the 
factors affecting response rates to mailed questionnaires. That study involved 
a meta-analysis of response rates from nearly 100 questionnaire surveys. It 
seemed that the most important* feature associated wilh a high response rate 
was the salience of the questionnaire to the respondent. Even though the 
length of the questionnaire, and procedural details had some influence, these 
were less important than the extent to which individuals saw the questionnaire 
as directed to issues of direct concern to them. The evidence presented by 
Heberlien and Baumgartner als0 showed the benefits of several reminders to 
those who did not initially return the questionnaire. 

Surveys of employers have been used in several evaluation studies of 
vocational courses. Wentling and Lawson (1975) considered that employer views 
could be obtained about tl\c course, likely supply and demand for labour in 
the area and the performance of graduates of the course. There would appear 
to be ethical problems involved in asking about th'e performance of individual t 
graduates. Such enquiries could make an employer aware of previously 
unnot iced^ def ic ienc ies . An employer survey concerned with these issues would 
need to be treated very carefully. There are also practical difficulties 
involving -^mployer surveys^ One prac^tical problem is the definition of the 



target popuiaticm for prograas not directed to a specific occupation. A 
second is to define who in & large finp should be approached for information. 
Finally, thjere is the question of an appropriate method of obtaining information. 
Individual interviews are tij^ ccmsuming,! but mail questionnaire ^rveys of 
Mployers* views are likely to Imveva low response rate because of the other 
d^»an4^ upon an employer's time. - ^ 

McKinhey (1977) noted that students and parents wera important sources 
of information abcmt a program, since they were most affeci^ed by the program* 
He also observed that they were not used as important sources of information 
as frequently as Taight be expected. This was surprising as they constituted 
a source of information which was mst readily obtainable. 

The methods tssed to gather information for the evaluation of pre-vocational 
and vocational programs have mainly involve questionnaires an(| interviews « 
They have been directed towards employers, former students, present students, 
and parents. Observation of either classes in college or former students at 
work does not appear to have formed a major part of many evaluation studies 
in this field. - ^ ^ 

Key Features of Australian Studies 

There have been several interesting Australian evaluation studies in pre- 
vocational education or similar fields* The Queensland Department of Education 
(1978b) in a study of its Pre-Vocational (Trades- Based) Course gathered the 
opinionSv^f students, teachers and employers by means of questionnaire and\ 
interview. As mentioned earlier in this chapter, this' stu^y was bashed on an 
analysis of Context, Input, Process and Product as defined l)y' Sl;uff lebeam 
et al , (1971),. Mackay et_ al_. (1978b), who were concerned with a more general 
range of technical courses, gathered information xrom potential students and 
those who withdrew from the courses, in addition to students, teachers and 
employers . 

An extensive study of Accelerated Apprenticeship Training by Griffin (1978p 
Sampled the views of teachers, employers and apprentices as well as assessing 
apprentice performance. This study was conducted within a theoretical 
framework derived from Stake *s (19^7) countenance model. A systematic frame- 
work of this typo provided a vialuable guide to the determination of data 
which needed to be collected. 

Kuhi (1978) argued a rationale for curriculum evaluation fiased on three 
criteria: curriculum function, curriculum process and curriculum theme. 
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Important f^et$ of the curriculiia function criterion were the specification 
of tasks, and skill profiles, of jobs in relation to objective methods and 
outcomes. For this reason it is a rationale ©ore appropriate for programs 
directed towards specific occupations than general courses. Schilling (1978) 
has reported an occupational survey of the autxiaotive paint refinishing 
industry as an example of this facet of curriculum evaluation. As pax:t of 
this job profiles of wprkers were developed, their training needs analyzed, 
and information about trends and developments in the industry collected. 
Information was collected by survey questionnaire and by interviews with 
employers and tradesmen conducts! at the workplace. This exaiaple showed 
the ^alue of a detailed analysis Of the working environment when planning 
courses of training for specific occupations. 

The views of past and present students-, employers^ teachers and ' 
professional associations formed the basis of an evaluation of a certificate 
course in business studies conducted by Cutter (1977). Problems associated 
with survey studies of employers were raised in this evaluation. Cutter 
commented that a significant number of questionnaires ^ were returned incomplete 
and that many were not returned at all. Part of the problem- would appear 
to be in defining the appropriate group of employers to whom the ' 
(questionnaire should be directed, and in developing a questionnaire which 
appears equally salient to the range of employers to whom it will be^dressed. 

Studies involving comparisons between new developments and traditji^nal <^ 
apprenticeship have been reported by HutchJson (1978) and Griffin (1978). 
Bitchison (1978) compared the performance of students from a pre-apprentice- 
ship course in signwriting ani screen-processing with tha\ of students in a^" 
normal apprenticeship program. A series of 't-tests' were used to test the 
significance of the difference in performance ^between the groups. No 
significant diffei^^pnce was detected. Griffin <1978) sampled students from »n 
Accelerated Apprenticeship Training Scheme and from normal apprenticeship 
as part of the study described previously. Rather than involve*siffiple 
comparisons between the groups, he conducted a more complex multivariate 
analysis using the type of program as one variable. The lattei^ approach is 
probably a moj^e appropriate method of analysis in such a complex field. 

Among the problems of research in vocational and pre-vocat ional education, 
is that of dissemination. It is possible to find reports of individual 
studies, though not all studies in the area are videly reported. However, 
there are no extensive and critical reviews of Australian/research in this 
area. Such reviews would not only guide policy but wouki be of great -value 
in the continuing development of appropriate research methodologies. 
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OiAPTER 5 • ' " 

■• 

' AN EVALUATIW fRA^EWORK 

The four pre^vocational education programs described earlier in this report 
have been ;chosen for study because they incoiporated some of the new develop- 
ments in this field. Two major problems involved in developing an evaluaticm 
strategy were the diversity of the occupational fields served by the programs 
and the bjeadth of the goals of each .program. As a method of considering the 
broad ranging set of goals of these programs a strategy based on the approach 
to evaluation suggested by Stake (1^67) was adopted. In orderfthat the 
strategy. might accommodate the diverse occupational fields involved, intended 
outcomes ifere classified as either general to most pre-vocational programs or 
specific to the program under examination. 
— . During the. process of developing this approach to' evaluation we rejected 

^ the proposition that it was possible to formulate a rigid methodology whij^h 

would%be applicable to all full-time pre-vocati^Sl education programs. The 
' wide range of pro^^ims in this field was such that any attempt to achieve 

this would not have succeeded. In addition it was apparent from the litera- 
ture on educational eva\iiation that the form of Sn evaluation depended on the 
^particular aspect of theaprogram to be evaluated. Though the present study 
Aas attenpted to be wide ranging, it has focused on issues involved in the 
transition from school to work. Other evaluation studies of pre-vocational 
education might be concerned with rather different aspects of the programs. 
The evaluation strategy which evolved was therefore sufficiently broad to be 
adapted to the evaluation of various aspects of different types of pre- 
vocational education programs. 
^ "'"'"■^is chapter contains an account of the procedures which were used in 

develdping the framework, a general outline of the framework, and a detailed 
description of the main- elements of the framework. Consistent with the . 
discussion in Chapter Four the m^n elements of the framework have been 
considered within the ^categories ha^fekground factors, processes, and outcomes. 
In this way an attempt has been made to define the essential elements of 
pre-vocational education on which an evaluation strategy could be based- 



DevelopiBent of the Framework 



Even though an approach, to evaluati^on based on the suggestions by Stake (1967) 
was adopted It was necessary to refine this approach to suit t^hc context of 
pre-vocational education. This refinement took place in three stages. In the 




first stage, which was exploratory, visits were made to colleges, classes were 
observed and interviews were cfinducted. The seconOtage^ involvec^^e^trial 
of soae instruaents in a small nuafcey. of colleges ;M Victoria.. Finally, as 
part of the third stage, there was a aore rigoyous trial of procedures in four 
pre- vocational education progranjs". 

Preliminary visits 

e major jpurpose^f the initial visits was to nwet those peoplf who had 
veloped or who were now teaching the programs. From disciissions with those 
people .it was possible to elucidate some of the key issues for the evaluation, 
to learn about the background to the prograas, and to establish procedures for 
later phases of the project. In addition, it was possible to deteraine the 
nature^f data held on official files, and the extent of other research studies 
being conducted. - 



After the preliminary visits it Sas possible to formjlate a broad outline 
of the evaluation strategy to be adopted and to develop some instruments for 
trial. The. trials involved interview schedules, semi -structured observation 
acheduleis, and questionnaires . * ' , 

Cl^s observation 

^ During the second visits to colleges, classes of different types were observed 
in operation in each of the four programs. The purpose of this activity was 
to determine if the activities used by instructors 'in practice reflected the 
intentions of those who 'designed the progfam. ft was important ^ "know what 
actually h^ened in classes in order to structure some 'sections of the 
questionnaire appropriately. In brief, the class observations were intended 
to be explorat;ory rather than confinaatory. To assist in recording observa- 
tions a semi -structured observation .schedule was use'd. This schedule' was 
primarily directed towards the extent to which an instructor atten^ted to 
relate the class activities to the world of work. K is important to note 
that this was a working guide to aid observation rather than a precise schedule. 
Such details inter-rater -reliability were not determined. 

Interviews , . • 

^ As an additional eoaq^cment- of the second visits to college^' V seVies of 

interviews was conducted with students and«teachers involved in these courses. 
The purpose of the interviews with students was to learn a little of their 
background, their motives for enrolling in the course, their views about the 

■ • ', V ' ' • •■ 



course, and their work aabitions» An open-ended questionnaire was used as 
a guide for the^e interviews which were recoried on a tape recorder. The 
use of the interview guides did no^ prevent specif ic- concerns of individuals 
being discussed. They TOreJy provided a base of common ground between the ^ 
integrviews. Tape recording of the'^ interview enabled questions to be fraiaed 
in response to previous answers so that a dialogue was established. 

Tpachers were interviewed in order to obtain their views 'about a nuiaber 
of iisyortant features of the prograns they taught. Once again ,a semi- 
structured interview format was used In conjunction with a tape recorder. 
Teachers were ask^d their views about the goals of the course, the difficulties 
faced by students, emphases in 'their teaching and the extent- to which they 
considered that the course was successful, - ^ 

\^ ' , ' ' \ 

The combination of visits, observation and interviews provided a 

perspective on important^ issues in pre-vocktional education raised in the 

discussion of the rationale for this field and*the goal^ of each program. 

Together with the literature relating to the transition from school to work 

these procedures enabled the major elements of an evaluation framework to be 

defined. T)w second and. third stages in the development pf a methodology fpr 

evaluation in pre-vocational education are described in the next chapter. The 

remainder of the present chapter describes the framework which was developed. 

The General Framework ^ 

In the previous chapter it was argued that the elements of the currici^lum 
identified by Stake (1967) provided a sound basis for the evaluation of pre- 
vocational education. It will be recalled that Stake had argued for a 
consideration of the rationale of a program and an examination, through 
description and judgment, of its antecedents^, transactions and outcoises. 
In adapting this framework to the evaluation of programs of pre^vpcational 
education we have preferred to use the terms background factors, processes • 
and outcomes, ^ 

Background Pactors 

« 

Among the imfSortant background factors in pre-vocat ional educatipn were student 
characterisf^ps,: teacher characteristics, and contextual factors. Relevant 
students characteristics included their motivat^^on, their career plans, previous 
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schoonitigf and hom and social background* Industrial expeHence and 
educational training soeaed iisport5B)t teacher characteristicsY and eas|>loyment 
opportunity in the occtfiational area appeared to be an iuqjortan^ contextual 
factor. 

Student motivati<»n 

In the general rationale for pre-vocational education it was implicit that 

programs in this field would be directed towards young people fishing to move 

ffoml sciipol to work. Determining the reasons stiKients entered the courses 

therefore Would b6 an iiaportant; feature of the evaluation. In examining the 

reason^ why students entered the programs it^ was considered important,, to 

est^lish whether students were entering courses for positive reasons, by 

default, or because of social pressure. Positive reasons could be considered 

to arise, from an extrinsic motivation to train for a particular job or from 

an intrinsic motivation to study something of great interest. Enrolment by 

default could arise as a result of a desired course of action, such as. 

employiaent ?is an apprentice, being unavailable pr as a consequence of general 

, uncertail^ty. Social pressure could lead to enrols^ts in a program to please 

parents or be with fjiiends . It should not be expected thgt foi* each student 

there would be one reason for comn^ncing a course. Rather there would be a 

series of reasons of varying strengths. It is argued that the balance of 

strength among these reasons' should be assessed. The way in which a program 

is structured and taught would generally take account of the motivation of 

the young people whd were enrolled in it- Most pre-vocational education 
« 

programs assumed that 4iudents Wj^re mainly concerned with training for a job. 
Career plans*' of students 

Closely related to the students* motivations for comnSencing the course were 
the students' job .plans. Several aspects ^of their job plans on eptry to, 
pre-vocatiorial education were considered, jpne was the extent to which they have 
a specified type of job planned for when they finish the course. As indicated 
in Chapter Three, some programs were intended to I^ad to a particular occupation 
while„ others had a more general qrientation. It would s'eem to be relevant to 
know the extent to which tlw^specificity of the students^ intentions matched 
those ^of th|^ program. In addition since the programs were concerned with the 
transition froJC school to work it would seem useful to know the; sort of 
considerations important to the students, in choosing a job. Infomiation about 
this aspect of student ambitions would be of value in determining course 
stiTJCture and content, ' > * ' 



Previous schooling 

Several of the pre-vocat ional programs describe in Chapter Three made assumptions 
about the school background of students entering the courses. Though none set 
at minimus entry requirement beyond the coa?)letion of Yepr 10, the actual entry 
levels seemed likely to differ between the courses. In one there had been a 
deliberate polity to provide for students who found Year 11 and Year 12 of 
secondary school* unsuitable so that entry was not based on school ability. By 
contrast another course had originated with an intention of attracting some 
more able students, then pursuing other forms of post-corapulsory education, to 
trade training. Given that there was some evidence that there were many more 
^plicants then places in some courses, it seeu^d important to determine the 
actual school background of pre-vocational students. 

A element in the school backgroimd factor would be the student's 
attainment and achieves^nt . By attainTOnt is^ meant the level of schooling 
which has been completed and by achievement is meant the degree of success 
the students had at sdiool. Of even greater interest in planning modifica- 
tions to existing courses would be so^ knowledge of specific areas of 
deficiency in student^* background knowledge and skills as suggested by 
Beeson (1978) for other programs. Though the determination of this was beyond 
the scope of the present project, its importance cannot b6 over-emphasize*. Of 
some importance in the evaluation of pre-vocational education would be a 
knowledge of the reasons students left school, and the type of school the student 
previously attended. Thi's information would appear relevant to the claim by 
at least one Techfiicai and Further Education authority that pre-vocational 
education was helping students who had difficulty in an academic secondary 
school. 

ilome and social background 

T\\c home and social backgrounds of students entering pre-vocational programs 
were considered relevant in two ways. Firstly, information about the socio- 
economic level of the students wafe important in knowing which groups in the 
community were being served by these programs. Secondly, such information 
would indicate whether there was an association between a parentis or^ 
sibling's occupation and tHe type of occupation preferred by the student. 
This would be relevant to the general issue of the extent to which young"^- 
people -modeK their career plans on the occupations of others in their fiuiuly. 



Table 5.1 Background Factors in Pre-Vpcational Education 



S^udfint cK&TSictAris tics 


Motivation . , 




Specificity of career plans 


V 


Previous schooling 






Teacher characteristics 


Industrial experience 




Teaching qualifications 


Contextual factors 


„Ei]5)loyiaent opportunities 



• 



Teacher characteristics ^ . 

If the rationale for pre-vocationsl education were to be fully iB|)leaented in 
the programs described « a great deal woul^^e expected of the teachers. In 
particular it would seem ii^ortant that they possessed both a depth of 
experience in work outside teaching and an understanding of the art of teach- 
ing. The observations made of the prograias in action seeiied to suggest that 
pre-vocational education functioned best when these two qualities were present 
These aspects of teacher characteristics seemed relevant to an evaluation of 
pre-vocational. education. 

Context 

Finally among the background factors was a aiost important piece of information 
about the context. This was the opportunities for employment in the 
occupational areas served by the program. Information about employment 
opportunities would be ii35)0rtant when interpreting the employment rates of 
graduates, as well as in planning expansion or contraction of the program. 

In Table S.l the background factors of pre-vocational education relevant 
to its evaluation have been summarized. 

Teaching Processes 

In the study of the processes involved in pre-*vocational programs attention 
was concentrated on three major issues arising from the role of these programs 
in the transition from school to adult life. 
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1 The extent to which students perceived their working conditions as ^ 
similar to those of someone in full-tiae eB^sloyiaent. 

2 The degree to which the teaching methods closely related the prograjc to 
the world of work. 

3 The practical enyhdsis in the course. 

In ^^dition to considering these three elements of the process of pre- 
vocationa^ education, two factors which could be better classed as pre- 
requisite outcomes p were studied. These two additional factors were not 
strictly processes but were thought to be iiaportant aspects of students' 
reactions to the course which would influence the extent to which desired 
outcomes were achieved. They would probably have been piore easily included 
under the general term transactions. ^ 

1 Student satisfaction with program in which they are studying- 

2 Student intereist in the course in general and its components. 

Each of these five elements will now be coimnented iqjon. ^ 

f 

As part of the discussion in Chapters Two and Three, it was argue^ that 
work experience during adolescence was an important part of^ the transition 
from youth to adulthood. There appeared to be established theories of 
development which supported that view. It was argued that in times when 
young people had less opportunity to gain this experience it was important 
to provide similar experiences by alternative means. In addition there were 
pragmatic arguments that by providing an environment similar .to that of work, 
* students would be better prepared for work. As a result of these considera- 
tions, a number of important aspects of working conditions were defined. 
These included the responsibility a person was expected to accept, the use- 
fulness and worthwhile character of jobs, being asked to decide how a job 
should be done, being treated as an adult, using modern equipment and being 
part of a team. Pre-vocational education programs were intended to provide 
an environment Vluch was similar to work in these respects. 

Teaching methods in pre-vocational courses were intended to be closely 
related to the world of work. This notion was defined as involving three 
main elements: an ^mphasis on ^useful' tasks and practical exasiples, 
consideration of the social aspects of work, and a concern with individual 
progress. These elements were c^sidered to be inter- related components of 



the overall concept of work-relaffed teaching. 
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Pxograaa of pre- vocational education were intended to have a practical 
eiqphasis which. was ©ore pervasive than just the working conditions and teach- 
ing methods* It was considered ii^rtan^ to attest to determine the extent 
to which students viewed their program as practical. 

It is not being suggested that these are the only i^ortant process 
variables worth examining in technical education or even in pre -vocational 
programs. The issues identified here are sinply those which seamed lapst * 
relevant to a consideration of the role of these programs in the transition 
from school to adult life. 

Student satisfaction with any educational program is an important 
consideration as a pre-requisi te to the achievement of course objectives. 
In pre -vocational education it is especially iuf^ortant because of the 
possibility ^at many students may have enrolled as a second preference 
after being unable to find work. Under these circumstances the level of 
satisfaction they express with the program is an important part of its success. 
Equally important, in this context, is the level of interest which they 
express in the program. It could be argued that to arouse interest in 
students who would prefer to betilt work would be important in itself as <well 
as important for the achievement of the programs objectives. It would seem 
probable that a program which did not arouse student interest would be loss 
successful in leading to employment opportunities. 

Pro^rani Outcomes 

Throughout the discussion of pre-vocational education in Chapter Two and 
evaluation in Chapter Four, the importance of evaluating immediate, interraediat 
and enduring outcomes of programs was stressOf|, The programs under Consi- 
deration at present were of- relatively 'recent jorigin , as was the whole field 
of pre-vocational education. Consequently eValuation of the enduring outcomes 
of the programs was not ^possible and attention has been ^^rrtcentrated on 
immediate and intermediate outcoi^es. For convenience of expression the 
intermediate outcomes have been i|s?ferred to as long-term outcomes, though we 
have Refined them as outcomes meaisured one year after the compiietion of the 
program.. Immediate outcomes were those which could be ^rxiasured on completion 
of the program, ^ 

The types of'^ variable to be considered as outcomes have been derived 
from'an analysis ofr the general goals of p|e-vocational education, the 
specific objectives of p^rticulaj programs, and the outcomes which have been 
used as criteria in the evaluation studies of similar programs reviewed in 
Chapter Four, 0- 
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Priorities 

It was mentioned previously that one iioportant and recent contributiofi to the 
theory of evaluation was the point that priorities attached to the different 
goals of a prograiB should be examined in addition to the extent to which those 
goals were achieved. We were able to identify the general goals of the 
various programs from a consideration of the rationale discussed in Chapter Two. 
These ^oals related to job training, personal development, work attitudes, 
basic skills, and social le;aming. 

Two important aspects of priorities among goals were considered. One was 
the emphasis which people felt should be placed upon the various goals. The 
other was the emphases which was actually placed upon these goals. The extent 
to which the intended and actual emphases on goals were congruent was an 
important part of the description of the program. The perspectives adopted by 
different groups of people about the program goals were also of interest. 
Certainly the views of students and teachers about the actual and intended 
emphasis on goals were relevant. Employer views about intended emphasis 
would also be relevant, though in the present study we have not attempted to 
obtain the views of employers. 

In addition to considering the general goals of pre- vocational education, 
part of the examination of priorities involved asking teachers to rate the 
specific goals, or objectives, which were stated for each program- Such 
'information, while highly specific to a given program, would also be useful if 
used in conjunction with teacher ratings of the extent to which each objective 
had been achieved. While the latter information may be rather subjective, 
when a median rating is taken across ail teachers it can be used as one 
indication of the success of the program in relation to its objectives. 

Immediate outcomes 

At several points in this report the intended outcomes of programs of pre- 
vocational education have been .discussed in relation to the rationale, 
specific objectives, and other studies in the area. The following outcomes 
were identified as being important and likely to occur immediately after the 
com])letion uf the course. 

1 * Technical competence of the students in the occupational area or 

areas appropriate to the course. ? 

2 Development of seHy^warene'ss and ||^1 f jponf ideiice among the students. 
' 3 Attitudes to work among the graduates of the [irogram. 




Technical coiBpetence could be taken to enijrace knowledge about the 
ccMitent of an occi^ational area, and the skills or techniques .associated with 
. tjie practice of the area. An ia?)ortant issue discussed in relation to full- 
time work preparation, or pre-vocational 'programs was the extent to which 
students- develop skills to the same level as those who study psrt-tia^ under 
such schemes as apprenticeship training. As previously indicated, it has been 
cl&iaed that while full-time programs can develop students knowledge of an 
Qcci^pational field to the smae extent as s^prentiQeship, and similar schemes, 
they, are not so effective in the development of skills. 

There are great problelas in the assessment of technical cos?)etence 
because of the lack of appropriate established tests in many occupational 
fields. In the next chapter it will be seen that we have used some tests 
where possible and st^jpl^mented these by the use of teacher ratings. 

The role of these and simi la/ pre- vocational education programs in the 
pex'sonal development of students is thought to be iB?)ortant. In particular 
the value of realistic work -oriented tasks i^ the development of an 
occL^ational identity, and the potential foV the development of higher self- 
. esteem through the acquisition of technical con^jetence, have been c(^sidered 
important goals of pre- vocational education. In this evaluation framework 
we have considered both aspects of personal development. Self-esteem, as 
defined by Coopersmith (1967) and explained by Ross (1974). has been taken 
as the variable representing the general aspect of , personal development;^ v ^ 
Occupational identity is a notion much harder to represent in operational 
terms. For this study the (consistency of choice among future possible 
occupations was used as an indication of the extent to which students 
developed a consistent pattern among their choice of occupation. There is 
some evidence th^t the consistency of a profile.^ occupational choices is 
related to thiJ development of t]\e abilijLy to make decisions about careers and 
the definition of an occupational identity (Holland and Gottfredson, 1975). 

In Chapter Two the need to define carefully the implications of the term 
♦attitudes to work' was discussed. It was suggested that attitudes to work 
should be distinguished from attitudes to particular employment structures. 
As a consequence in this evaluation framework two aspects of attitudes to work 
seemed relevant -and consistent with those ^arguments advanced previously. The 
first was a positive attitude to choice of career as an important decision. 
The second was a desire to achieve satisfaction from good perforinance. 
In the next chapter, two soales which were used to measure these notions will 
b^e discussed. It should be emphasized that these two variables do not cover 
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all the relevant aspects of' attitudes to work which could be considered but 
they do define two relevant aspects. 

It is worth considering career maturity in more detail. As discussed 
by Crites (1969) and Super (1957) this refers to the development of the 
ability to make decisions about careers or jobs, Crites (1973) has argued 
that career maturity involves making consistent and realistic choices, 
displaying competence in planning, and being positively oriented to the 
making of decisions. The Career Maturity Inventory (Crites, 1973) ?.s based 
on a series of competence tests and an attitude scale. The competence tests 
\are concerned with knowledge of one»5 own aptitude and of jobs, and skills 
an planning, choosing jobs and solving problems. An alternative approach 
is that of Super and Forrest (1972) in the Career Develoi^ent Inventory, 
which is concerned with an individual's planning orientation, resources for 
career exploration arwi information and decision making. The full Career 
Maturity Inventory is a lengthy instrument to admi^nister and has not been 
tried in the development of this methodology. One form of the Career 
Development Inventory is a research form and is^ rather shorter (Super and 
Forrest, 1972). This instrument was not tried in the developaent of the 
methodology either. However, the construct of career maturity did seem 
relevant to pre-vocational education and other stales in the field could use 
one of these instruments, in its assessment. In f he present study consistency 
of career choice was studied using a different approach related to occupational 
identity, and the attitude scale of the Career Maturity Inventory was tried 
as a mfrasure of one set of attitudes to work. This has been reported more 
extensively in Chapter Six. 

Intermediate outcomes ^ 



Foilow-'Up studies of course graduates appear to have provided the most 
common means of evaluating programs similar to pre-vocational education. 
The major reason for the use of this as an evaluation method would appear 
to be a belief that a pudding cannot be judged until it is |feten. It is 
argued that for courses directed to work preparation, an assessment of what - 
Hap|>ens at work. is es.seiitial. A second reason for the extensive use of 
follow-up studies could be the fact that it is difficult to define and 
measure immediate outcomes such as technical competence. However, a probleni 
involved with the assessment of intermediate outcomes^ ^by either 
longitudinal studies or cohort studies, is the fact that the longer after 
course completion the assessjnent is made the less certain i^^ the association 



between the outcome and the course. * 
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It wijl be recalled that in the discussion of issues involve in the 
transition froB school to work, a successful transition was considered to 
involve laore than obtainio^ a job. Job stability axKi job satisfaction were 
also considered important, Heyice in the evaluation of prograias of pre- 
vocational education thv^f intermediate criteria seemed approJ)riate. 

1 Rate of emplpytnent aaongst, course graduates 

2 Job stabilitiy • . * 

3 Job satisfaction 

Reservations about a simplistic use of employn^nt rates as an evaluation 
criterion for pre-vocational programs have been expressed. Yet, for jl^ 
vocationally oriented program some attention mist be givjen to the employment 
of those people who complete the program.' In the framework being advanced 
here it is argued that attention must also be giyen to whether the fields 
in which the graduates of the program, obtain work are congruent with the 
field of the program. Though employment in another field has sometimes 
been considered misemployment this, term is fraught with danger. As noted, 
even the most specific pffe-vocational programs provid'e skills useful in a 
ran^e of occupations • A person who completed a program in c^ftpentry and 
'joinery and obtained employment in a builder hardware store ought not 

to b« considered to be misemployed even though he did not commence an 

... 

apprenticeship as a l^uilder. In more general pre-vocational programs the 
definition of"^isemployment is even more difficult. For these reasons it 
is important to examine in detail the types of employment which former 
students enter as part of the study of employment' rates. , In addition it is 
impbrtarit that when employment rates are considered that they be examined 
in the context of emplO}finent opportunities in the appropriate occupational 
field. As a result of such an examination it could be concluded either 
that the program was ,not producing skill^ suited to the vacancies which 
did exist or that insufficient vacancies existed to justify the program 
on a juanpower basis. Or, the program imight still be justified on other 
considerations. 

Job stability has been mentioned in some official literature on pre- 
vocational educat ion^^AKEC , 1977) and refers to the number of different 
jobs an individual holds in a given time, or the average time in each job. 
A' number of important questions surround its use as a criterion of program 
effectiveness. One arises from the possibility that job changes could be 
made for a variety of reasons. In the current economic climate young people 
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,iaay be obliged to accept an inappropriate job with a view to changing to a 
better one as soon as possible. A second concerns the issue that it may not 
necessarily be a bad cHitcc^ ^or young people to try a number of jobs in the 
^ years after completing a program.^ A third/ and final, issue concerns the 
fact that many job changes in §o»e industries arise because of instability in 
the industry resulting in small xirms closing down or retrenching staff. 
Cons.equently we suggest that job stability should be studied in detail and 
consideration given^^o: 

1 overall job stabifity, 

2 the types of job changes involved, and { 

•» 3 the reasons participants give for changing jobs. 

. • • However, iti terms of interaediate outcomes measured about one year 
after completion of a program, it would not be expected that many people 
would have changed jobs. *^ 

Job satisfaction has been argued to be an important, but neglect^, 
aspect of the transition from school to work. It is probably more greatly 
influenced by the nature pf .the working environment than the program which 
was completed. ^However, a program in pre-vocational education could be 
considered to contribute to subsequent job satisfaction in two ways; 
by providing the opportunity to #nter more satisfying jobs and by enabling 
an individual to adapt more readily to working life. Both of these factors, 
but particularly the sexrond, constitute strong grounds for examining job 
satisfaction as an intermediate outcome of pre-vocational education. In 
considering job. satisfaction in this way it is important to use measi^res 
which differentiate different components of job satisfaction rather than 
global measures. For the present study we have used a measure based on 
satisfaction with' work, supervision, people, pay and proTOtions, The 
structure of the instrument is dispus§ed mote fully in the next chapter. 

A further criterion for evaluating the intermediate outcomes of pre- 
vocational education is speCif icy.4i£l some programs. Success in further 
studies undertaken former students is an important measure of the 
success of pre-apprent iceship programs planned to lead into apprenticeship 

r 

training and other more general programs intended to 'provide a broad 
introduction to such training. Performance in both the technical education 
and the job performance aspects of this training would be relevant, as 
would be evidence of the rate of withdrawal from apprent iceship . ^ 
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In luidition Information frc^ forser students can provide valuable t 
informant ion abcHit the usefulness of the program. This information could*' 
provide 8^ further criterion: ^retrospective satisfaction with the prograa^ * 
Even though some might not consider this as a program outcome, it has 
been mentioned as part of this fraaework, at this point » because the 
information can be 6f great value in judging or modifying the progr^m^^ 
In essence it provides information about the congruence between the program 
md the world of work. ; * /; 

E yiuring outcomes 

Since programs of pre-vocational education are of relatively recent origin 
it has not be^n possible to examine systematically any enduring outcomes of 
programs in this field. However/ the importance of these outcomes should 
be stressed. The eiviuring effects of sohooling have been actknowedged to 
be a neglected area of research CH^mqvist, 1977) largely because of the 
practical difficulties and expense of establishing contact with participants 
some years after a program has been completed. A recent piblication which 
reviews American research in this area possibly consstitutes an indication • 
of aroused interest [Hyman et^ aU 1977). 

Typical /enduring outcomes of pre-vocational education would include 
general adjustment, job success and satisfaction, work motivation, job 
planning ,/6oiapeten9y and short term job orientation. ^ 

r^is the confeprion of this report that a great deal of theoretical 
development is stili^equired to adequately define th& variables to- be u^ed 
as criteria for evaluating the enduring effects of these educational programs 
HS^rnqvist (1977) categorized the studies of enduring effects which he 
reviewed as those primarily concerned with values and attitudes and those 
mainly concerned with the attainment of occupational status and income. 
Consistent with the view adopted in the role of pre-vocational education 
in the transition ^rom school to adult life, we believe that these types, of 
criterion can be augmented with some more general measures of satisfaction. 
Recent research, involving var^ied approaches to assessing the Quality of life 
experienced by people (Andrews and Witney, 1976) and the structure of well- 
being (Burt et_ al_. , 197^) offer the profepect jf even broader approaches 
to the eirfuring' outcomes of these programs. ^* - 



88 9S 



Table S.2 The Main Elements of an EyaluatiPn Strategy for 
?re -Vocational Education 



V 



General Category^ 



Major Elesent 



Element 



Antecedents 
CBackgrpund 
Factors) 



Student ^Characteristics 



Transactions 
(Processes) 



Outcomes 



Teacher Characteristics 
Context 



laract 



Environment and Jtet^od 

Student Reaction 
Inuaediate Outcomes 



Inte'iAiediate Outcomes 



Motivation 

Career Plans 

Previous Schooling 

Home and Social Background 

IiKiustrial Experience 

Te^l^ing Qualification 

Employment Opportunities 

Realistic Working 
Conditions 

Integration in Teaching 

Practical Emphasis 

Satisfaction 

Interest • 

Technical Competence 

Self-esteem and Occupational 
Identity 

Attitude to Work and Career 
Maturity 

Employment rate 
Job Stability 
Job Satisfaction 



The Framework in Retrosnect 



;In this chapter we have attempted to coipbiTle many aspects o'f the rationale 
and objectives o£ programs in pre-vocationai education, with a consideration 
of important i'ssues in program evaluation. As a 'result a systematic framework 
has been derived which incorporates the important -issues associated with the 
role of , pre-vocational education in the transition from school to work. 
The important general caXegories of elements of the framework were 
background factors, processes, /and immediate, intermediate and enduring outcomes. 
In. Table 5.2 the elements of the framework have been sunmiarized. 



As indicated in Chapter Pour, evaluation studies in pre-vocational education 
could be concerned with differ ij')t ion and/or judgment. Studies concerned with 
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description might focus oti the logical contingencies between each of thte 
elemeftts, thp ctepiricai contingencies between th«B, or the congruences 
between intent iojis aiul observations with respect tq each. Studies cgnceriJed 
with judgment would coapare the observed nature of each Element ^ 
defined standard: ei^er another group or an ideal. Ntost cojaaionly 
judgmental studies would involve the outcomes of a program. Chapter Seven, 
will deal with issues of analysis involved in such studies. 
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CHAPTER 6 



STRATEGIES AND INSTRUMENTS 



It seemed appropriated ^o'^^S^^ ^ discussion of strategies and instruments 
" which could be use4?in conjunction with the previously described framework, ^ 
with a few general ajpsaents. Following these general coiments is a suisna^y 
of the first trials pf some instruments. The more detailed section of the 
chapter consists of ifi discussion of the student, teacher and career ^ j 

questionnaires^. Lt 4j a little more technical than previous chapters. A 
series of tables at the end ^of this section provides a suimaary of how data 
about each element hag been collected. It should be stressed that there will^ 
be methods of gatheritig the requested data which were not tfied as part of 
this project, but whioih will probably emerge from future studies. The 
chapter concludes with a discussion of pr6cedures for sampling student^ anjj 
for the administratis of questionnaires. 

General Comments 

In the previous chapter interviews with staff and students and obs/rvatioi 
of teaching were mentioned as techniques which wei;e used in the/evelop^nt 
of an evaluation frameWprJc. Those same techniques could be api4 i«d as/means 

gathering data ars part of an evaluation strategy. A recently 'published 
source -book of instruments for evaluating classroom instructrioji coi^ains a 
valuable review of a number of observation and interview schedules as well 
as questionnaire materials (Boirrich and Madden, 1977). l4ie obsef^.vation . 
schedules were classified according to whether they focfised aftentioii on 
teachers, students or the class. Not all the schedulers yevii^ed would be ' 
appropriate for programs in Technical and Further Edi/cation/ It s^^'^s • 
important that evaluation studies of processes m s^ciy pro^^aais as pre- 
vocational education should concentrate on vari 
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with the world of work, integration with societ 
elements of the program rather than on gene 
action. Few of the schedules reviewed appea 
directly. In developing the guide used for 
of pre-vocational classes, the scales of Fori 
emphasis on integration were helpful, as we. 
of Gump (1967). However, the instrument 
was only -to guide preliminary observation 
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of ihtegration 
ant^egrati^n between 
l^-^sroom inter- 
nvoiv.e t)iese iss^s 
the /t^relAmina^y observation . 
i77)/concemeci with* 
hejtcaQner^s role categories 
wajfe used in this study , 
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Most of 'the instruaents developed or adapted iiv this study have been 
quest ioxuia^^e materials or tests. '?his policy was followed because it seeaed 
that such materials would be capable of providing rapid ^feedback of information 
to Technical and Further Education authorities. Having made that statement, 
it .is necessary to issue the qualification that in most cases .the value of 
such instruments would be enhanced by the complementary use of some less 
formal methods of gathering evidence. 

We bedieve that evaluation in Technical and Further Education will prove 
Uo be of greatest benefit if different studies use some coamon items in the 
questionnaires which are used. The use of such marker items would eqgble 
synthesis of important results to be more readily achieved. This sentiment ' 
v^s expressed in the introduct ic^^ to the collection of survey instruments 
uSjCd m the study of regional Colleges of Advanced Education (Beswick bM 
Barman, i975:l-4J}, Indeed we found that collection of instruments helpful 
in^developing some items in the questionnaires used in this study. Items 
from those questionnaires, or modifications of th^, have been used in the, 
extension o!£^ the Regional Colleges Survey k^nown as the Cajeer Devll'S^ment 
Project (Beswick et_ al_. 1979) and as part of a national ^ucation survey 
conducted for the Committee of Inquiry into Education &id Training (Seed, 1979)* 
The form of some questions used by Beed involved move simple expression to 
suit the wiJer audience with which that survey was concerned.* As a result of » 
this co-operation a body of iijformation on issues common to different courses 
is growing. This is valuable for comparative purposes. We therefore 
inciudfg some items in our student questionnaire from these sources though 
in several cases it was necessary to simplify further to suit our respondents. 
Of course there were many issues unique to pre-vocational education which \w 
could not bfe investigated in this way, but it seemed important to include some 
well -establish^ items for comparative purposes. Other important sources 9f 
ideas were the study by Rosier (1978) and the Melbourne Careers Prdject (1978)/*- 
As a result of the trials we found it was necessary to extensively modify some 
of the items we had intended to use as markers so that t\\e level of language 
difficulty suited the students with whom our study was concerned. ' In spite 
of this, one criticism of the questiorinaires which were developed and used iix 
the present study would be that the \evel of language involved wa^s still too 
difficult for student4 of pre -vocational education. In the final forms it 
was possible to reta/in a few marker items in addition to- those which were 
either developed or/extensiveiy modified for this study. * 



For the &sses$aent of soa» of the outcomes of pre««vocational* education 
there were soae standard iBstruaents wkich seeaed suitable, ifhere necessary, 
publishers permission was obtained to use these in the development of a 
TCthodology, Future use in ^ other studies itfould require an agrea£ent between 
the user and the imblisher. \ "sj , '/ . 

The following materials were either developed or used in the study of 
pre -vocational education, ^^^^^^ 
1 ^ A Stiidcnt Questiomiaire, . . • , 



2 A series of Teacher Questionnaires with' modifications to suit each of 
the four prograss. . * 

3 A Career Questionnaire for the follow-up o<^^£onser students'. * 

In addition a series of/^ est , materials relevant to -the programs described *in* 
Chapter Three was tried^and a quest ionnaire* requesting basic information r 
from students who did not gain a place in a course was constructed. 

Trial Questionnairt s 

— — ■ ^ ^ ^ 

As part of the initial sta/es of questionnaire development '^rial forms were 
developed. The first tri/l was a tri^'al of some potentially suitable 
instniments rather than the totai^valuation stfk^egy.- Subsequently/ the 
questionnaires were revised and used in the main tyial oir the strategy^ y 

A trial form of ai^iKient quest ionha ire focusing upon background factors 
and teaching processeif of ^137 technic^K college students in Victfria. 
''Included in the samp/e were SS stuoentsVrpm a secretarial studies cours^, 
and 25 studeAts froa an electrical Jirades pre-employment course, i^ta analysis 
^of the trial aainw involved simple frequency and cross-tabulation analysis 
together with son» T;?4liability estimate of scales. * , 

Among the j&t^eresting results obtained from this group of stMiients were 
the fol lowing / ^ . ' 

1 The mo important reason for leaving seconcfary school was a belief 
that 4id not le^d to good job opportunities. 

Most i>i the stvcients considered themselves average or above average , 
in fiEh^5ol .work . 

/ ■' . ■ > 
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I Nearlys, one-third did not have & specific job br career in mind when the^ 
left school, and nearly Half did not intexxi to obtain a Ci)llelee qualifi- 
cation at that txm* 

Stud^tfiL^^ted job training as the most important reason for enrolling 
in their current -course but almost equally important was the desire *to 
study in a field which reaUy interests me'. The ratings given to these 
two factors correlated Bjoderately (r « 0.37) suggesting that 'extrinsic 
aii4 intrinsic interest among these students need not be seen as in 
conflict, , * • 

Most students indicated that they were satisfied with their college, 
found their course interesting,, and expected It to be useful for their 
int^ded occupation. ' • ' , . 

.The items showing the greatest discrepancy between the aaphasis giyen and 
the emphasis which students believed should |iave been given to various 
goals of education were 'tjie^ development of self-awarerjess aiui self- 
confidence' followed by *the development of attitudes to assist in 
settling intci a job'. In both cases less emphasi-s was actuallfy given 
than students felt should be-givjen. 

On> number of 'aspects of their working environments students considered 
their college to be similar to work'. * 

-Very few students had 'jobs arranged prior to finishing their courses and * 
most Anticipated difficulty in finding a job. More than half indicated 
that* they woul,d leave the course if a suitable job became available. * The 
factors reported to be i*st important in choice of job were, in order, 
interest', satisfaction, working conditions, and security. 

9 At the time the questionnaire was administered most students either knew 
exactly the job they wanted or were deciding, between two or three jobs. 
A3 most did not ha^^e a job in* mind when they left secondary school this 
"suggested that some de^elopwsertt 'of career intentions may have occurred 
^during their ^technical college co'urse* ' ' ' 

Since this was a trial, the sample w^is not carefililly drawn and the results 
obtained ^^hould be treated with caution. For this reason the points listed 
above have b%en stated in general tenus rather^ than in precise figures. 
Neitrerthel^ss they give an indication of the way a group of students in full- 
tim^ technical col lege* courses responded to these questions. ^ 



Tke data from the trial werenot solely used to obtain data for 
statistical analysis of' scales. When the trial questionnaire was administered 
a number of the project staff were present to observe and report difficulties 
students had-witli particular questions. Many alterations were made to the 
format and to individual questions in the questionnaire. The data analysis 
was also valuable. For example, the reliability of the scale which assessed 
the practical eiaphasis of courses was only moderate (alpha = 0.60). but was 
improved by omitting onfe item (alpha = 0.66). In addition to these specific 
changes to questions the questionnaire was restructured so that pers'onal 
background data were sought after information related to the course. 

In addition to the formal trial, consultations were held with staff , in 
T0chnk:ai and Further Education autjhorities about the structure of the student 
questionnaire. 

The Attitude Scale of the Carc^^r Maturity Inventory (Crfttes, 1973) was 

also administered to a sample of st^^udents in Victoria as it was designed to 

measure important aspects of attitudes to work. There were 1^3 students 

from secondary or secondary technical schools, US in full-time TAFE^work 

preparation courses, and 72 apprentices, TKe sample was chosen -from areas of 

similar socio-economic status. Frdifi. an analysis of the data the following 
^ 1 
'conclusions were drawn. \| 

I . ^ - 2 

1 ^ The scale wa^s sufficiently reliable for use in research (alpha = 0.80), 

2 A factor analysis^ did not yield results congruent with the theoretical 
foundation postulated by .the ^author . Consequently it was not possible 
to use subscalcs. 

5 Students in full-time vocational- courses scored higher than those in 
general secondary courses. 

Because of the inconclusive nature of the factor/^^natysis, it was decided tp 

I .'1 
conduct a further trial of ^e Career Maturity Inventory Attitude Scale with 

the students in the prc-vocat ional programs. 

The teacher questionnaire, and the career questionnaire for former 
students were not subjected to a formal tKal but reviewed by groups of people 



See Append i!t A . 
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^ Factor analysis provides a means of examining the construct validity of a 
scale or a scries of subscales. For an introduction to the .technique see 
Ch;ld. (1970). . { 
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in the resciiarch branches of S^ate Technical and Further Education autlu)rities. 
As a result of that procedure many alterations were made before they were used 
in technical colleges. ' ^ 

^ The Student Questionnaire 

• ■ * « 

The Student Questionnaire was designed to obtain inforroflLon about background 
characteristics^ processes and outcomes , It was planned that it should be 
able to be conpleted wi^hin^ one hour: the^uration of oost class lessons, 
in pre-vocational education. In the planning and trial of the initial 
questionnaire it was apparent that the inforaation being sought might require 
aore time, ^erefore a strategy was adopted for collecting thc^information 
desired without iifiposing too great a burden on the respondents. The 
questionnaire was structure in two sections: A and B. Section B consist^ 
of two alternative forms : ^otm Bl and form B2, In cnir stixdy when the 
questionnaire was administered copies containing form Bl were given to one 
raiKiomly chosen half of the students and copies containing form B2 were given 
to the remaining half of the students. This precedure enabled, information 

collected on a wider range of variables than would have been possible 
within one hour if all students had to answer all questions. It was important 
that the total group of students be split at random for this procedure to 
provide useful information. The extent to which each random half is Similar 
on other factors could be checked by* using responses to the common Sejztion A 
of the questionnaire. , , * * , 

A copy of Section A of the Student Questionnaire has been included as 
Appendix B. ForiB ?1 contained the Coopersmith Self -Est e«n Inventory (Adult 
Form C), and a scale measuring the desire for further development through 
work taken from the study by Bachman et^ al_. (1971). Fo^rm B2 contained the 
Attitude Scale of the Career Maturity Inventory (Crites, 1973). The sequence 
of. questions in, and the format of, the questionnaire were planned to sujt 
the students who were to answer it rather than the framework described in 
the previous chapter. It is worth considering the que^ions and st:a}es which 
form part of each of the main elements of the framework. ' 

The ]5ackground factors to which the Student Quest ionflaire was directed 
included student motivation, career plans, schoQl^ackground, and home and 

s 

social background. . { 
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Stiident laotivation , ♦ 

It is inportant to recognize that the reasons wtiy students enrol in a course x 

such as pre -vocational education are j^obably COTplex. An ultimate decision 

to gnbark on a course is most likely to be based on a nuBiber of influences 

rather than on a single reason. To obtain information about the relative J 

strength of a number of influences on the decision to commence a pre- 

vocational program, a format similar to that "used in the Regional Colleges 

Survey (Beswick and ilarman, 19*75) was adopted. Students first rated 

the importance of various reasons for starting the course on a five-point 

scale and then underlined the most important reason. For the study of pre- 

vocational education some of the items listed in th^ Regional Colleges study 

were deleted and others specific to ,pre -vocational education were included. 

Of special intelrest were the items which^indicated the balanqe of extrinsic 

and instrinsic fac^'ors: to get training for a job and to study in a {ield 

of real interest. There is scope for a major study of the balance of 

extrinsic and intrinsic motivation arong Technical and Further Education 

» 

students but not in the, present study, " In the present study we have been able 
to glean on|.y a superficial indication of these issues. Question 11 of the 
studenjt questionnaire was included to provide the b^sic information abou^ the ^ 
reasons why students commenced their course, - * 

For each stated reason it would be possible to use the ratings on the 
five point ordinal scale to obtain median, values and thus ^determine the most- 
important of the reasofis for conssencing the course. As a ^eck on validity 
this could be compared with the reason most frequently underlined. The 
correlati'ons between the ratings given to each reasoil could b^ calculated to 
enable the associations between various reasons to be ftudied. 



Career plans 

When the relevant aspects of students' career plans were discussed -in the 
previous chapter, two important aspects were identified. One concerned the. 
specificity' of a student's career plans on entry to a course. 'The other 
involved the considerations that a student considered important in seeking, 
a job. Such informAtion, it was argued, should be used in planning course 
Structure and content. 

(a) Specificity . Qitestions about the specificity of students* career 
'plans were included at several placets in the student questionnaire, (^estion 
5 is the most direct of these being concerned with the students' plans "on 
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leaving secondary school. It is directly comparable with a question from the 
National Education &iCTey (Beed, 1979) \ Additional information about the 
stu4ents* plans could be obtained froa Question 2J which was modified from an 
item in the Regional Colleges Survey. C^estions 24 to ^6 also concern 
specificity of career plans but are directed to students in the course 
rather lhan background factors. \ ^ 

Choice of job . In educational programs intended to facilitate the 
transition from school to work the fadtors important to students in a choice 
of job could be relevant. In Question 23 students were asked to rate the 
^mpi?rtance of a nunlber of factors in the choice of a job. Some of the items 
in this question were used in a study by Rosier (1978). Most were developed 
for the present study and cover a wide range of possible facttt's which might 
influence the choice of a job. 

School background • - 

In Chapter Five it was argued that relevant aspects of school background in 
a study of ,pre-vocat ional education would include attainment, achievement, 
reasons for leaving secondary school , type of secondary school and experience 
of work. • ' 

(a) Attainment , Prq-vocatioiial education has been generally intended 
io be a provision for those people leaving school after Year 10. It was 
therefore of interest to know to what extent places in the available programs 
were occupied by students who had contii^ued their secondary schooling beyond 
this stage. Question 2 wa^ concerned with the student's attainment. 

(b) Achievement . The ievei of school achievement among entrants to 
pre-vQcational educatioo was of interest in'examining the pattern of intake, ^ * 
Tiiis information was generally available from official sources and was not 
requested in the 'questionnaire . 

(c) School typ e. The type of secondary school attended by studehts 
•was indicated »by the answers given to Question 3. It was relevant because of 

the well established differences in retent i vity- of different typos of school. 

(d) Experience - Even though pre-vocational education is intended to ^ 
provide for students coming direct from secondary school it is possible that 
somrv students may have had experience of work away from school. Quest;^ons 6, 

• 7 and S were directed towards obtaining this information. They are similar to 
items included in the National Education Survey (Becxl, 1979). 

(e) Leaving school . Different programs of pre-vocational education 
have made different clainis a^bout the students to whom the programs were 
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directed. Some clai© to provide for students who found secondary school 
unsuitable • Through Question 9 an attempt was made to elicit infoftaation about 
the reasons why stiidents left secondary school. for the reasons for 
conmencing the course, it was decided to assjess the relative imjKjrtance of 
each possible reason by asking students to rate the importance of that 
reason for them on a five point scalcv* Some guidance abouli the items listed 
was obtained from Rosier Cl^JS^-^-^'T^i^^ ratings for each reason could then 
be calculated to provi^J^^ indication of its impHDrtance in the decision of 

t m 

Students to leave school, ^ 
Home and social background 

Home and social background has been ^considered to be a- mUltifacet ed constrnct.' 
It -has been considered' to be isade up of a gryp^ of variables: socio-economic 
status, ethnicity, family career influence-! and peer group influence-/ 

(a) Soci^-economi^ status . The most comiiK?nlV used index of \he social 
level of an individual in- a community is -^based on occupation. One approach 
used in Australia by Congalten (1969) has been to class occupations according 
to their perceived prestige in the community. A second approach, adopted ^ 
by Broom-, Jones and Zubrzycki (1969) was to develop an occupiitional 
classification in te^ms of the .level of skill and rewar^i involved as well as^ * 
social prestige. Even though occupational status has been shorn to be ^ 
correlated with other measures of social standing such as education, income 
and subjective social class, the measures are not identical (Broom et_ ^l,- 1968). 
In spite of the limitations associated with the use of obcupational status as 
an indicator of social standing it Is a measure on which relatively obje<itive 
data can be obtained by questionnaire or interview. 

Information about the social standing of participants in various 
educational prtjgrams will be of greatest valu6 it compatable data are collected 
in different studies. For this reason we advocate the use of the 
classifications and scales developed in the Department of Socioloj^ in the 
Australian National University. Three scales have been offered l:iy Broom- 
Jones and Zubrzycki C^9b9) ^or use in soc i^D^logical and educational studies: 
a sixteen point scale, a coarser six point scale, and a*" nine point 

1 

classification designed to differentiate rural and urban occupations, 
^ recent publication (Broom, et^aj,- 1977) has explored further the 
characteristics of these scales. 
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An illustration of the distribution of fathers' occupation among pre- 
vocational students has been shown in Appendix C. 
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.In "this study we have used the , sixteen point ^caAe for coding purposes. 
A wore exhaustive thVee digit coding would be time, and money, consuiaing* to , 
code. The Sixteen point scale can be collapsed to give eithe^i* of the shorter 
scales or used with weighted social status measures (Broom er al^. 1977), 

The validity of such a coding system depends upon obtaining accurate 
i descriptions of occupations to be coded. For this reason it was necessary 
to request that the occupation of the person actually be stated, and a 
description be given where neciessary. Questions relating to the occupation 
of parents and siblings can be considered intrusive of privacy. In the 
student questionnaire for pre-vocational education the questions relating to ■ 
occupations have been placed at the erui of section A so as no): to arouse early 
hostility and so that they could be omitted without jeopardizing other data. 

The socio-economic status of a student has ^sj^lly been taken to be 

indicated by the father's occupation. In the present questionnaire the 

c^ccupati^n of the student's motherland siblings were requested. This was 

not for use as an indication of socio-economic status but to enable the 

detection of association between the types of jobs taken or aspired to by 

» members of the ^amevfamily. (^astions about the occupations of parents and 

siblings, and of the students' aspired to and expected occupation, can be found 

as Questions 35 to 40 of the student questionnaire. 
' A/. 

(h) Other family . In the section above the as^ssment of socio-economic 
status has been discussed'. Other aspects of family activities are relevant 
^n considering the entry to vocational training. Among €he influences ' 
considered* important are the occupations of eldet siblings, and parents. 
In this we .have been interested in the extent to which students » aspirations 
were associated with thai occupations^ of other members of the family. 

0^) Ethnic groups . Given the multicultural nature of Australian 

society it would appear useful to know the ethnic origins of the students 

entering pre-vocational education. In seekfng this information it is 

important to know not only the country of birth of -the student but also that 

of the parents. In addition the length of time which those st^udents not born 

in Australia have lived here provides valuable information.' Questions 31 to 

'34. 'provided relatively direct means of asking for this information 

' f ' - 

(d) Peers . An .additional potential .influence upon young people at , 

the point oi" leaving ♦school is that of their peer group. One means of 

obtaining information abou^t peer influences is to ask what a student *s best 

three friends from school are doing. For pre-vocational students. eight 
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possible activities were no»inated so that students could indicate what their, ^ 
bei^t three school-' ^iends.^Are currently doing. Questipn 10 provided a s^ans 
of obtaixuiiji that information, 

■ * . * . 

-.. ■ * 

Teaching. Processes 

in Chapter Five a niimber of important evaluation questions concerned with, 
processes involved in progr^s of pre-vocational education were ideatified: 
working cohdition^, teaching methods, practical emphasis, satisfaction and 
interest and difficulties. Previously it had been argued that the study of 
such process ele3Qent:s was w essential part of an evaluation stt^y. This 
section is concerned with the means of obtaining students' perceptions of 
the processes involve in pre-vocational education, 

i^y Working conditions , fn examining students' jferceptions' of their 
working conditions attention has been focused on a number of issues which 
were identified' in Chapter Two as important contributions from the 
experience of, work to adolescent development. These issues involved 

, responsibility, doing 'worthwhile' '^asks, making decisions, adplt treatment, 
using laadem equipment, aiKl contributing to a joint effort. The format 

k which has ''been used in Question 20^ involved students rating on a four point 
scale a series of sfateaents^about aspects of typical working conditions for 
themselves, someone at work, and someone at high school, A sample statement 
has been included in Table 6.1. A study by Flude and Wiiteside (1971) found 
that when students in printing apprenticeships were asked to rate themselves 
on a -scale with respect to their perceptions of themselves as a -student or as 
a worker, there was a shift towards the exKi of the scale designated ^worker' 
over the duration of the course. For the present study of pre-vocational 
education an attempt has fceen made to define the important aspects of work 
rather than to use a global perception, and ask for relative perceptions rather 
than to seek to defect changes over time, A principal component analysis of 
the responses to the questions concerned with college conditions showed t^at 
only the first principal component had an eigen value greater than one.^ 
That ^component accfounted for 46 per cent of the total variance. This evidence 
CQjifinned that these questions were measuring different aspects of the same 
dimension. Subsequent analyses suggested that a*, reliable scale measuring 
the. extent to which college conditions were similar to the* world of work 



See Appendix C (Table C2) 
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Table ^.v You and Ypur Work! Sample Statement -? . / # 

. . — c ^. ' . 

• x . ■ • .' ' V • • ■ - . . • i 

' ^ Consider the^ following statements about aspects of typical-^orkiag » 

* . conditions* Compare your worki9g conditjibns, with what you \^ink the 
working conditions^ would' bjs^iJe^for; . i * [ , 

• \' (i) f stmient in a sepondaryv sctKsol / and* ' . . ' •* 

♦ ' (ii) someone in' fuili-tiine eeiplpyaent/ ] ^ - 



(Circle on^ nu^ei; in eaph row) 



Responsible'. for ones own work 



N^v^c^ Rarely ' Sometimes, Often 



4 



in college 1 • - 2- 3 4 

tn wori^ / 1 ' . .2*' 3 4r 

in h^gh school ^ 1 ' 2.3- 4 ' 



Note: A domplete set of* stataaents can be found in Appendix BV; 



could be fbj^ed*£rom these items. It was fouiui that the alphi/rel lability 
was 0,76. x^^ales ' which measured the perceived conditions for someqne in 
high school coujd also be formed with alpha reliabilities of 0.71 and 0.73 
respectively. The three scales could thus be used with some confidence; 

Por the study of pre-vcpational education it was possible to use /the 
nediap ratings for each domain relative to high school and college in addition 
to using aggregated Scale statistics. Anfi^mportant premse underlying *the types 
of pre-vocational education programs described in Chapter Three was that it 
wa^ possible to simulate conditions at work. If students view thai/ working 
'^conditions in this way ^hen college conditions would be rated as more similar 

to"* work than to high school. The results obtained from this instrument have 

Ik- 
been discussed in Volume Two. ^ 

(b) Teaching methods . To obtain student^' views of the teaching ||kt^hods 
in pre-vocational education a scale was "included as Question 19 which wm^ 
developed around the theme of teaching methods related to the world of .worX, , . 
Three major domains were included within this notion: 'an emphasis on realistic 
• tasks and examples^ integration with the social aspects of woark-., and concern - 
to develop mastery of ^kills. Examples of items from each of these three 
domains have been shown in Table 6.2. A total of 21 items was developed. 
The introduction to the items which has been used was intended to capture 
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Tiltble 6*2 Teaching : Typical . Items 



^Domain - " Itesn 



: .... V ' 

• 

• ♦ 

Realistic tasks and examples' 


* 

Provides some W3rk for stiidents 


> ^ * - \ 


which, is Similar to what they would 




,* \ 

^ '4o when they findsh theyzour^e. 




\, ' ^ 


• 

Indiviiual progress and ' 


Gives enough time to complete a job. 


^stery 

* • 




. Social aspects of work 


Discusser the relevance of topics 


0* 


for our society. ** 



the essence of teaching methods in the^program generally. It was based on 
the format 'think of a typical terf^gf' as used in another context in the 
Regional Colleges Survey (Beswick and Harman, 1975). If the same scale 
were being used to study a particular class or subject in a program a 
different stem would be used and revalidation would be necessary, 

A principal components analysis of the responses of students in four 
pre-vocational programs from seventeen colleges showed that while four 
factors had an eLgen value greater than one, th6 first component had an eigen 
value of 6.1 but the others were 1.6,. 1.4 and 1.1 respectively. ' On the basis 
of a scree test (Cattell, 1966) it would seeis valid to treat the scale as 
measuring a single dimensionH^^ the extent to, which teaching methods were 
related to the world of wor1<*. A high score would indicate teaching methods 
which were strongly integrated with work whije a low score would indicate 
that students viewed teaching methods as divorced from work. 

Further analyses showed that the scale was very reliable with 
coefficient alpha » 0.S6 but that it^s 10 and 20 appeared unrelated to the 
remainder.^ If tho^e items were^leted the alpha reliability would be 
higher still: perhaps reaching 0.88, Ail the ^items had ftean values just a 
little greater than the midiK^int of the range and standard deviations which 
suggested a good spread of responses. There was no iteqi where the limitf of 
the scale caused disjprtion. flt* ^ 



^ Refer Appendix C (Table C4) 

■ Item 10 ^Sets deadlines for w6rk to be completed' 
Item 20 'Requires correct spelling and expression in written work'.^ 
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A factor analysis was conducted which involved a varis&x rotation of 

all four principal factors with an eigen value greater than on« to determine 

^ whether the internal structure of the scale reflected that Which had been 
1 ' ' ' « * 

postulated. The first factor was interpreted as .representing teaching methods. 

involving the use of realistic practical examples ami tasks. The setond of 

the factors appeared to be concerned with the emphasis on methods which 

^^^^^^^^^^^ ^he mastery of important skills, Th^thi^d factor appeared 

to b^ ^?ite:^v?jich reflected the Social aspects of Work as incorporated in 

^ teacl4t^«kh^^ by discussion of social relevance ^and tha ei^couragement ^ 

of ciCdperaUon. Finally, the fourth factpr was dne on which only ite© 20 

had a loading greater than 0,3. Together with tKe fact that it6m 10, did not 

load on any factor, this confirmed the interpretation that these items which 

were concerned respectively with correct spelling and expression and the 

setting of deadlines were discrepant and should be deleted frqm the scale. 

An alternative to using the full sjcale in the evaluation of teaching 
methods would be to form subscales based on the results of this factor 
analysis. Further work would need to be undertaken on this task but it 
would appear that subscales which were not independent, but which were 
reliable could be obtained. Of course considering the nature of* the scales 
one would not expect independence. 

(c) Practical emphasis . In order that student si perceptions of the 
practical emphasis in the courses could be evaluated, a press scale was 
developed foiiowing ideas of Stern (1970), The first attempt 
at this scale was included in the Victorian trial and found to have a moderate 
reliability. After modification for the main trial the scale was still ^ 
only moderately reliable with a value for coefficient alpha of 0.52.^^ It 
would appear that the scale requires further development before At could 
be considered for use as a research instrument but that it coulc| be used for 
preliminary explorations associated with the present study. \ 

, The seal e^ was an attempt to look at'the total environment of the program 
by incorporating the' attitudes of j^eers and teachers, A high score would 
represent a practically oriented environment while a low score would represent 
an environment in which practical things were not strongly emphasized. It 
seems probable that the multifaceted nature of the dimension under 
investigation limits the reliability which could be achieved in such a sc^le. 



1 

Refer Appendix C (Table C5) 

2 

Refer Appendix C (Table C6) 
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The itoa total corrtlations wwld certainly indicate that^'»ore than one 

. 'J ^ ■ ;.■.'•-/ • ■• . 

attribute was being tested. ./ 

(d) Satisfaction and interest. / \ix Chapt^ Five the reasons for 
examining student satisfactio^ and ^bterest in programs of pre-vocational 
education were elaborated, apprc^iches to the- a^sess^nt of^iihiffent 
satisfaction have be«i adopt«L One approach, in Questicfn 17, )^ to ask 
V students the extent to whic}^' t^y, agreed a nuwbej: of statements of 
complaint. .The format was ^iimilai^ to that used in the Regional Colleges 
&irvey {Beswick axuJ Harm^, 197S) itnit using the, individual statements as 
modified in the Career Deyelopeieiit Project (Baldc^k^^ H^ and Langford, 
1977) and the National £ducat;i(^n/su^ey (Beed, 1979) , It was based on 
the six items, each with fjure respcnsi^^q^^ formed a Likert^scale. 

An analysis of the re»iltS:obt^ned flf^ iit four pre-vocational, 

programs from 17 college^' sj\6we^ that th|?^ scale was a fairly reliable 



measure of satisfaction (aJt^a."? 0.6S); Of course, in examining, a program 
the response to individual iteate might; prove an additional useful source of 
information. An alternative approach %diich was also include a$ Question 13 
of the questionnaire was to ask students directly about their overall evaluation 
of the course. This qiiestion was the.^e as one used in the National 
Education Survey fay Peed (1979) and couW thus be used for c<»ipari5on iHirposes. 

Related to student satisfaction is student interest. Question 12, wtiich 
is a marker question identical "to one in the survey of regional colleges, > 
asked students directly about their level of interest in the course. In 
Question 22 more detailed info*iaation about interest in particular^^eas was 
requested. In that question information was also sought about difficulty " 
and doaands, $0 that those issues could be separated from interest. 

(e) Difficulties , An .additional area concerning' processes is that of 
the level of perceivai difficulty which students have in certain general areas. 
In Question 21 they were asked tOi indicate areas which were difficult and 
the amount of help which they had received in those areas. Such information 
could be of value in planning for additii^al instruction in particular areas. 
The areas listed were based on those which have been the subject of comment 
about the competence of apprentices and other young workers. 

Pii^ram outcomes 

The evaluation of outcomes in the area of technical competence does not form 
part of the Student Questionnaire. Rather it derives from test results and 
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ratings by others^ However, the^ assessment of ^rioritie^ among various goals 
of pre-vocational education and certain affective outcomes was a .function of 
the student qqestionnaire. ^ 

(a) Priorities . Que^ion 14 students, were 'asked to indicate the 
emphasis given to a «series of, five- general goals in their program ax^ their 
opinion of the emphasis' which should hive been given to. each of *t hose goals. 
The idea for the* question came froiB ^he survey* of regional colleges Tseswick 
and Harman, 1975) though for the students in pre-vocationaL education * 
different statements of- go^ls'^aiKl some simpler wording of goals have been used. 
In additioiV, after the Victorian trial i- «t different format of the que'Stion 

wa^ adopted fo enable students more readily to separate the two types of 

question bei^ig asked, in particular the response categopr 'not stxre' was 

eliminates as it appeared to cause confusion to students-; ^ - ' * ^ 

■ ^- ^ * 
* '" ^ ' 

Median ratings could be calculated fox. both the actual ^and desired emphasis 

on each goal. The desired emphasis ratings'could then be usefl to indicate the 

students* priorities and the difference between the two, ratings to indicate a 

discrepancy score. It would appear that this type of question can provide 

valuable information. A large discrepancy score on a gdal of high priority 

could indicate that csome revisions to either course content or teaching 

n 

methods were needed. ' 

(b) Personal development: self-esteem . In the development of a 
methodology for evaluation the assessment of se-lf^esteem of students has been 
attempted by means of the Coopersmith Seif-Esteenr Inventory) (the S.E.I.)- This 
instrument is based on a view of self-esteem as being; 

the evaluation which the individual makes and customarily maintains 
with regard to himself: it expresses an attitude of approvaT or 
disapproval, and indicates the extent- to which the indivicfual believes 
himself to ^be capable, significant, successful, and worthy- In short, 
self-esteem is a personal judgment of" worthiness that is expressed in 
the attitudes the individual holds toward himself, (Coopersmith, 1967:4-5) 

There are three forms of the S,E,I. available: a full 58 item instruipent, a 
short form of 25 items, and an adult form of 25 items. The full inventory 
though intended for 10 to 12 year olds has been widely used throughout 
Australia for other age groups and has been the subject of extensive 
validation (Ross, 1974). It has 50 items designed to measure self-esteem, 
and eight items which form a lie scale. Ross showed that it 'was possible to 
use the instrument to give either a total score, or scores on three subscales: 
peers, parents and school. The adult form of the S.H.I, has been used less 
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extensively in Australia and does not give scores on ^ubscales *but it has , 
aji .equally iapreslsi^ reliability . C^opersmth (1375) indicated a test-retest 
reliability df 0*88 and a correlation with the long for® of 0,86, 

*hough'less Tes'earch' has been reported in Australia using the adult forto 
of tKe S.E.I. , it ha$ been preferred in the study of pre-vocational ^ucation 
foi* two reasons. Firstly, the wording, is'much more suitable for students in 
post coifipuLsory education and secondly, it is sh9rter and less time consuiaing. 
. Moreover it Is possible to relate scores on the adult foris tp those on the 
complete form, ' * • * ^ 

, . In the trial of the methodology among students of pre-vocat ional education 
/ it was found that, the adult form of the S.E.I, had a satisfactory reliability 

"iTtjalpha » 0.76).^ All the items correlated well with the total score, except 
items 2 and 19 which referred to a person's confidence in verbal expression. 
None of the items was sUch that more than SO per cent of the students gave 
the same response* These results suggested that the instrument waf suitable 
for studies of self-esteem among pre-vocational students* ^ 

• t (c) Personal dt?velopiiient : occupational choice . Occupational choice as 

jused in the present study has been taken to' refer the extent to which 
iiklividuals in pre^vocational education develop^onsistent patterns in their 
Lchoice of future occupations* The method which has been tried in this study 
j is an adaptation of, an approach used in the Melbourne Careers Project (Kelso, 
1978) following a method suggested by ^k>lland, Gottfredson and Nafziger (1975) 
' which was based on the theory of IJolIand (1973), According to Holland, 
occupations can be classified into six broad categories according to the 
environment of those occupations. The six categories, with examples, j^re:' 
-'realistic (tradesmen), investigative (scientist), artistic (designer), social 
(teacher), enterprising (salesman, manager) and conventional (clerk). It has 
been argued tfiat some types of occupat*ional environment are more similar 
i th*an others (Hoi land > 1973). In the study of pre-vocational education this 
! framework was used to evaluat'e whether students had established patterns of 
future possible occupations consistent with the type of program ip^-wfiich they 
were studying. Hence, while such studies ^s the Melbourne CjK^ers Project 
related stated possibilities to vocational aspiration, in the present proje'ct 
they were related to the program in which the^students were enrolled. 



^ See Appendix C (Table C&) 
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The question ou/^ich this approach has been^ based is number 28. The 
first stage was to assign the prograia to one of the six categories described 
by Holland (1973) . SeocmtflyX each stated possibility was coded as belonging 
to one of the same six c&teg^^ei. Thirdly, scores were assigned to each of 
the possibilities accordin|; to rTSiKparoximity on Holland's hexagonal diagr 
(Hollai^, 1973:23) to the prograsa classification: 



If they were identical the score was 4. . 
If they were adjacent the score was 3. ' 

If -they were neither adjac^i^t nor opposite the score was 2. * 
If they were opposite th^ score was J., ^ " 

Finally the scores ^ere added^d divided by the total fiuaber of 
possibilities. This procedure follows that of the Melbourne Careers Project 
(Kelsot 1978).^ In t^e present, project dt was possible to write a cossputer 
program to perform the third ai^ final steps of thp scoring. ^ 

Using this procedure ^e maximum possible score was four aiui the minimuia 
would be one. A T^igh s^^oi^ would indicate a range of future possibilities 
consistent with thejfcype of program undertaken while a low score would 
indicate a scattered range of choicesr, mapy of which were not consistent with 
the prograia. It would seem that pre-vocat ional education ought to bel^r 
acquaint students with the occupations consistent with the course of trainirfg 
they were undertaking. It is possible to interpret a high* score on this 
measure as resulting fros btfth a good understanding of jobs in an area anS froia 
the development of a sense occupational identity. 

(d) Altitudes to work; career maturity . The attitude scale of the 
Career Maturity Invent-ory (Crites, 1973) was tried with a view to assessing 
its suitability as an instrument for assessing one aspect of attitudes to 
work. It is one scale from a group of tests. , The remaining scales comprise 
the competence test: self-appraisal, occupational information, goal selection, 
planning and problem solving. Even though the competence test may prove 
useful in other studies of pre-vocational .education it was not used in the 
present development of a methodology. Permission was obtained from the 
publishers to try the Attitude Scale as part of the methodology.^ The 
particular form of the Attitude Scale which was tried was the screening form. 



1 ' • 

Any subsequent use in evaluation studies would require an agreement with 

the publisher, CTB/McGraw Hill, Del Monte Research Park, Monterey, 
California, United States of America, 
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The ite«5 on the scale were structured around five dimensions: 
involvement in Clfbi^e, oi*ientation toward work, iadependence in $ieci^ion . 
making, preference for career ^:hoice jud conqeption of the choice^ process • ' 
Jn total the scale is inteixied to measure maturity ii attitudes towards a 
career, ^ifty items scored in a true-false format make up the scale whiqh is 
intended to assess an individual's maturity with respect to attitudes to careers, 
^ Crates ( 197 S) has review^ the source ^f the evidence from the United States N 
involving its use. Its internal consistency {Xuder Richards6n Formula 20) 
averaged 0.74, and the test-retest reliability was 0,71. In additiorf its 
validity had been examined usijig panels of expert jidges tojrate each item 
Q and by relating scpres to a series of external' criteria. In general it - W 

appeared to be both a reliable ajA valid instrument. In the present^ trial '9 
it was intended to check its reliability whffn used in pre -vocational education 
and to test its appropriateness for the evaluation of programs this field.' 

As part of section Bl of the questionnaire it was administered to about 
one half^ (165) of the students in these programs. The internal consistency • 
was found to be satisfactory for research purposes (alpha * 0-79). Mean 
scores were a littfe lower than might have been expected oti the basis of 
United States norms. This was similar to the results obtained in the Victorian 
"trial where full-time Certificate of Technology students scored higher than 
general secondary students. Neither group scored as high as the equivalent age 
group in the United States. A factor analysis was conducted to determine 
whether the five theoretical dimensions could be detected and a set of sub- 
scales derived. Seventeen principal components were extracted with eigeil values 
greater than one suggesting that the scale samples many different facets of 
career maturity.^ A factor analysis based on the rotation of five factors 
did not give a clear pattern which could be easily interpreted as representing 
, the five theoretical dimensions, A Scree test suggested that three factors 

might be present, TJierefore a factor analysis based on the rotation of three 

2 

factors was conducted. A tentative interpretation -of the three factors 
appeared to be as follows: ^ 

1 The extent to which the respondents saw future opportunities as 
^ uncertain, and therefore the extent to which they were likely to have 

the opportunity to choose a job. A high score on this factor would 



^ See Appendix C (Table C9) 
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See Appendix C (Table CIO) 
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reflect a perception of the future as stable, and^ th^ choice of 
job as a decision to' be open to thaia. 
2 The extent t© which the respoiKients. were oriented towards making a 
choice of career[based on considerations of interest and commitment 
to the work, after seeking advice. This factor reflected the extent 
to which respoTidents lorSlted forward to work. A high score would* 
iefl«ct a positive attitude to work and a commitment to make ajj 

J formed choice of job, 
e extent to which the respondents w^pre personally certain in their 
choice of career. While the first factor involved a perception of the 
, environment as stable, this factor was related to personal uncertainty., 
A high score would reflect a high degree of certainty a^out future jobs. 

The emergence of a factor structure involving the first' factor described above 
is probably a reflection of the changed employment market in Australia in, 
recent times. While there was some correspondence between- tlhis structure 
and that which guided the development of the instrument, it wa§^ot cle^r. 
.It was therefore not possible to use subscale scores. 

iEven though the attitude scale of the Career Maturity Inventory does 
not take^ong to administer it is lengthy in terms of the number of items. 
From the item analysis it appeared that some items were much better correlated 
with the total score than others."^ This would suggest that it might be 
possible to develop a shorter instrument which measured the same general 
construct for use in syrvey studies of vocational courses. It should be 
remembered that the scale was developed for use with students in general 
secondary education in the United States, and validated among that group. 
Therefore it is not surprising that some differences in strU'cture were found 
when it was used with pre-vocat ionai students in another country. ■ Any further 
use of the instrument would need to take these considerations into account. 
The construct being measured appears to be an important aspect of pre- 
vocational education, but it ought to be able to be assessed with a shorter * 
instrument . ^ 

(e) Attitudes t o work: development . In assessing the extent to which 
pre -vocational students express a desire to develop their skills and 
knowledge through work, a scale used by Bachiuan et_ al. (1972) was used. This 
was described by Bacliman as measuring a need for self-development: a concept 
related to need for achievement but directed towards the idea of wanting to 



develop existing talents ami acquire new ones. Bachman argued that the 
environment of educational institutions might aff^t student's expressed need 
for self-dfivelopaent *in work. The instrument w^js a 15 item l/ikert scale. 
The results of administering the instrument to 204 students in pre-vocational 
programs suggested it, was a Reliable instrument in the Australian context. 
The alpha reliability was 0.84 and all'the it^s.were strongly correlated 
with the total score !^ Together with th^e validity data reported by. Bachman 
et al. (1972) ^his suggested that it could be a useful scale. 

The Career- Questionnaire ^ ^ ^ 

The Career Questionnaire, was 4-ntended to be completed by former students of 

pre-Vocational education who had b^en in the workforce for about one year. 

Consequently it was designed so that it could be ccbplet^ in about 15 to 20 

minutes. Its format followed a logical sequence in time since the completion 

of the program of study. It began with questions about the person's first 

full-time job, then asked questions about changes in ^ployment, enquired 

about the re^^ndents present occupation, then asked people about how they 

felt about their job and concluded with an invitation to make retrospective 

judgments about the pre-vocational program which they had completed. In 

.proceeding through the questionnaire there were two places where some 

respondents could omit some of the questions. Respondents who had not obtained 

* • 
a full-time job could omit Questions 1 to 11, and those who had made no 

^{lan^es in their ]8b could omit Questions 7 to 11, A copy of the Career 

Questionnaire has b^een included in Appendix B. • 

• As indicated in the develojxnent of the evaluat^n framework, the Career 
Questionnaire was intended to obtain information about four intermediate 
outc^fmes of pre-yocational educational^ programs . 

1 ' Employment patterns 

2 Job stability 

3 Jab satisfaction 

4 Retrospective satisfaction with the program, 
Employment patterns 

In examining the employment patterns of . people who completed pre-vocational 
education the Career Questionnaire has been concerned with more detail than 



^ See Appendix C (Table Cll) 
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• rate of Mploy»ent. Often State T6clmical and Further Education authorities 
Maintain records of Miploy»ent rates which can provide useful inforaation. 
The questionnaire was^concemed with the pgttem of present eaployaient aaong 
fecent graduates, Ouj pattern of first jobs aaong those people, and details 
of uneaploysertt aaong those people. 

Ca) ^>resent eaployaent . * Questions 12, 13 and 14 concerned ^he present 
^€aplo)^ent status of graduates. Fr(ai resppnses to Question 12 (a) it 'was- 
possibl-a to deter^ne the g(iiwral/^vel of ejnployaent aaong these people 
including whether the eteployaent was full or part-tiae, permanent or 
teaporary, and' as an apprentice or not. Question 12 (b) sought awle detail 
about the jobs of people, so/ that it could be deterained whether the work 
was in their field of ^training. Th? issue of 'aiseaployBent » is a difficult 
one, and therefore Respondents weM askecf to ii^icate. whether they believed 
their present job was in their field of training. Finally, details about 
the period of employsient for those who were uneaploy^ were sought in 
Question 14, ^ , 

f^irst efflployaent . Siailar information describing , each person «s 
first job as that about their present job was sought through Question^ 2 
and S, In addition {^estion 3 asked -about the time taken to secure a fir^t 
full-tiaie job and Question 4 asked about the source of that job. 

(c) Unemployment . Even though information about current unefflplqyaent 
was obtain^ through Questions 11 and 14 it was also important to enquire 
about total unemployment. As requested -in Question 15 this wa's'takpn to 
include time before obtaining regular job and tisse spent as uneKployed 
between successive jobs. \ ^ 

Job stability ^ • 



In Chapter Fiye some reservations^ were expressed about the assuiajfeton that job 
stability among young people was necessarily a good thing. Since these 
reservations were held, questions were asked not only about job changes but about 
the nature of, and reasons for, those changes. Some of the questions in this 
section were adapted from similar items used in the Career Development Project. 

(a) Job changes . Question 7 asked simply and directly for the number 
of different jobs a respondent had held since completing the course. It 
provided a direct, if simplistic, measure of job stability among graduated 

(b) Type of change . In C^iestions 8 to 11 information has been sought 

about the types of changes ineaployment made by the target population. The 

> 

information being sought was related to two underlying dimensions: the nature 



* of the change and the reasons for the change. The key is^e in the nature 
of the job changes/ were whether the changes were within the saae field, and 
whether the changes werjg" towards a field laor^ appropriate to the person *s 
field of training, ^n examining reasons for changes two approacjies were 
adopted. One was to ask for a brief but open ended. st at eaent while the ^ 
other asked respondents to rate the importance of a series of possible 
reasons for changing oobs . ^ 

. Job satisfaction * ' , 

Measures of job satisfaction have been reviewed togeth^ with measures of 
other occupational attitudes by Robinson, Athanasiou ami Ifead (1969), Aaong • 
the range of scales which they reviewed ^ms the^ Job Description Index 
developed b>^ Smith 'et_ al^. (1965) . This ii^ex attempts' to laeasur^rjob 
satisfaction in the five areas of type of work, supervision, pedple dn the 
job, pay and proiaotions. The first three areas are assessed by <aeans of 18 
item scales and the latter two by 9 item scales, making up a total of 72" 
items. The scales essentially comprise a check li^t .of adjectives or 
descriptive phrases against which the respondent indicates an answer of 'yes', 
'?', or 'no'. Such responses are scored 3, 1 or Q respectively. Several 
items are revers? scored and details are provided in Robinson et_ ai^. (1969) 

There were foin- major reasons for trying this measure of job satisfaction 
in the development of an evaluation strategy for pre-vocational education. 
One was that 'it had been used in Australia an^ng present and former tertiary 
students as part of the Survey of Regional Colleges ^Beswich and Harman, 1975) 
and the Career Development Project (Baldock et_ al^. , 1977). There was 
, therefore a possibility that some reference points had been established. The 
second reason was that it seemed a reliable and valid instrument on the basis 
of data from studies in the United States. Robinson et al . (1969) mention 
the extensive research which went i;ito the development of the instrument 
and impressive reliability and validity data have been reported. Split 
half internal consistency measures above 0.80 are reported for each scale 
and a variety of Validity studies have been conducted. The third reason for 
trying this itistrumen;: in the present project was its simplicity and 
uncomplicated terminology. Finally it appeared to be a face-valid 
instrument which did not take long to complete: factors which were' felt 
likely to assist in obtaining a high rate of response. 

The use of the instrument in the present project confirmed that it ^as 
highly reusable among young workers in Australia. Values of coefficient 
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alpha which have been reported in Table 6*3 ranged ^rom 0.S2 to . As 
has been reported froio United States data, the correlation coefficients 
reported in Table 6.4 suggest ^t|h |ft th e five scales are not statistically 
independent. This could be M^^^llF^ indication that general, job 
satisfaction is being measured hy the tqtal score. ^ In fact' coefficient 
alpha for the total inst/maent was ^.92! In trials associated with the 
evaluation of pre » vocational education both scale scores and total scores 
have been tried. 



In summary the Job Description Index proved to be a reliable and useful 
instrument for assessing the job satisfaction of young workers who had 
completed programs of pre -vocational education. 

Some data relating vto the validity of the index were also obtained 
as part of the present project. Scores on each^l^ale were obtained from a 
sample of people who h^d completed pre-vocational programs intended to lead 
to apprenticeship. It wa^ then possible to compare the scores of those who 
obtained apprenticeships with those who did not. It would be expected that 
apprentices would report greater satisfaction, on the 'work' scale, and . 
possibly the Vpromotions' scale, than non-apprejitices, but that there would 



Robinson et^ al^- *[1969) recommended that those interested in fuller scoring 
details and normative data correspond with Prof. P.C. Smith, Bowling G^een 
University, Ohio, USA. 
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Table 6,4 Inter-correl&ti^ns betweei^ Subscales of the Job ^ 
Descriptive Index 





Work^ Supervision 


People 


. ..^ . 


ProBjotioji 


tr 

WOTk 






HO 




Supervision 




43 


J 

33 


16 " ' ' . 


• People . . 


- ■ « 


V 


' 24 ^ , ■ 


' Pay 

A. ■ ■ — . . ^ ■ 






N 

% 

_^ - . 


.35 . ' .. • 

P 



Note: Deciaial poitits have^been omitted. 



ttiree, : 



ie less difference on the remaining €Kree, scales. Th& results in Table B.5 
corroborated t}>is pro^sition and supported the validity of the scales. In 
the case of the 'work' soAle the difference was about three quarters of a 
stl^ndard d^ikation. On the 'pronK>tion' scale the difference was about one half 
of a standard deviation, while for the 'pay* scale the difference was only about 
) one third^of standard deviation. For 'people* and 'supervision' the differences 
were trivial. ^ 



Retrospective ^satisfaction 

% As argued in Chapter i^'ive it seemed that recent graduates of a program of 
pre-vfl^cational education would be well placed to judge its effectiveness. 
'^In particular it was stated that this infoiunation would provide a good 
.indication of how well the program had actually prepared young people for 
the work which they entered. ^ 

- / • ' 

In Question 21 a series of eight ways in which such a prograiB might 

have prepared people for work were listed- Respondents were asked to rate 

how well the program had prepared them in each respect. Median ratings on 

each aspect could then be calculated. ■ It'would appear that these ratings 

* 

could be of value in evaluating particular aspects of a program. In addition 
the items were considered to form a scale of retrospective satisfaction with 
the program in general. Such a scale was found to have a satisfactory 
reliability (alpha = 0.83), and would appear useful, in progrpat, evaluation 
studi«s.^ The high internal consistency was an indication th^t former 
students who were satisfied with one aspect of tileir course were also 



See Appendix C (Table C13) 
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Table 6.S Mean Scores on Subscslf| | ^f Job Oescription Index for 
Graduates of CcHirses Leading to an Apprenticeship 



Mean 



Apprenticed 

Standard * 
Deviation 



Not Apprenticed 
Mean 



F ra^io 



Standard 
Deviation 



Work 


. 34.47 


11.27 


39 


24.92 


14.13 


1" ■ 

24 


5.789** 


Supervision 


37.32 


S.36 


39 


36^58 


13.. 01 


24 




People 


40.75 


9.71 


36 


39.05 


12.09 


21. 


.340 


Pay ^ . 


15,53 . 


.7.86 ■ 


36 


13.14 


6.96 


22 


1.748 


Proaotion 


14.21 


7.28 


34 


10.59 


6.26 


22 


3.66^ 
1 



** p < .01 
8 4p « .06 



satisfied with other aspects of their course. The median ratings on a five 
point response scale (1 * very well , 5 » v^y poor) were mostly between two 
and three. There was a fair spread of responses over the response categories 
available. 



The Teacher Questionnaire 

The quest ioi^naire which was prepared for teachers to answer was also based 
upon the general framework of background factors, processes and outcomes. 
In the Teacher Questionnaire some -questions more specific to particular 
programs were asked. Consequently it was necessary to prepare four different 
versions of the questionnaire, #ne for each program under review. The three 
forras. A, B, ancf C which were' tried in the office-training, polytechnical 
and chemistry programs respectively differ&d in minor ways from each other. 
. Fonn p, which was to be completed by the teacher resp<5i4ible for the 
carpentry ami joinery programs in each college., was substantially different 
from |he other three forms though it contained some questions common to the 
others. A sample copy has been included in Appendix B. 

The various teacher questionnaires have been given tmach less extensive 
trials and should be regarded very much as pilot instruments^. In fact the 
only trial was in each of the col leges^where the various pre-vocational 
programs were studied. The total number of teachers responding to all forms 
was only 42. 



ERIC 



116 



123 



Bacfcground factors ^ • v ' 

Aaoog ^he background factors about which inforaation was scmght froai teachers 
were soaic concerned nfith the background of students aiKi others concerned * 

with the teachers, 

• ' . 

Student'^ school baoic^rcRind , In the case of the Office Training, Poly- 
technical apd Cheaistry Programs inforaation was obtained froa officiir records 

course adaission policies and the qualifications of those whQ applied 
and those wRo-ii«xgadi^tted to the course. For the Carpentry and Joinery 
Program this inforaation''^?»9--ahtai£^ by questionnaire froa each of the 
colleges (Questions 1 to 4). In studies Invaiv^ing prograas conducted in a 
large number of colleges, the foraat used in Carpentry and Joinery would seea 
the better approach. - 

In addition to inforaation of this type a question was devised through 
which teachers could' iiuiicate the extent to which specific difficulties were 
encountered by students in the course. This was included as Question 3 in 
Forms A, B and C, and as Question 8 in Form D. A saaple haa been included 
in Table 6.6. Median ratings accorded each of the problem areas could be 
taken as an indication of those aspects of students' backgrounds which teachers 
perceived as causing the greatest difficulty. Two other keans of eliciting 
inforgiation about students* difficulties were tried. One was to ask^teachers 
to estimate the percentage of students, for whcm each area was a problea. 
The other was to invite teachers to nominate the areasCiiy which they thought 
students* backgrounds were deficient. To coaplement tl^s teachei^s were asked 
in Question 9 to indicate whether certain areas were important for ^success 

xn the progjc^. ^ ^ 

> * 

Teacher ^ s background . In addition to asking teachers about their 
views of the students' backgrounds, some information was requested of 
teachers: their qualifications, work before teaching and teaching experience. 

Teaching processes ^ ^ 

Where possible it would seem desirable to obtain teachers* views of the 
teaching processes involved by using scales which are of a parallel form to 
those of the students. Hence a question about working conditions for students 
(Question 6) was included in Form A, B and C of the Teacher Questionnaire, 
In fact it was an early version of the question used in the Student Questionnaire 
and did not provide as suich informat^jgj^^s it might have. A series of items qn 
which teachers could' rate their own teaching was included/^s Qifestion 7 but 
could not be analyzed ^s a scale because of the small sample size. This was 
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Table 6.6 Student Background IGio wIe dge: ^ Sgtaaple Item 

Listed below are a miid^er of difficulties whidi so»e students have when 
they begin a wrk preparation course. Could you 

(i) indicate the extent to vjbich these were problems for your 
students when they began this year» and 

(ii) indicate the percentage of students for whom you thought this 
was a problem? . 



Extent of Problaa 



^Consider- 
We 



^k^erate SI ight None 
\ — .1^ ^ . 



Probli^as of reading at 
a sufficiently high 
level 

Trobleias of spelling 
and written expression 

Prbble&a^of pei^forming 
vathe^tical calcul- 
ations 



Percentage 
Students 



Problems of verbal 
expression 

^Probl^s with manual 
'dexterity 



an early version of the Teaching Methods and Work Scale fro® the Student 
Questionnaire. A better approach would be Xo use the stem of Question 7 
from the Teacher Questionnaire and the scaled of it^s from the Student 
Questipnnaire as jaodified from Question '19. ' This would give the opportunity 
to match student and teacher views Of teaching processes. 

In Form D of the Teacher Questionnaire used in the carpentry and joinery 
■program more direct questipfis were asked about specific issues affecting 
the teaching processes in that program: principaHy the time spent on the 
construction program. 

Program Outcomes 

In the Teacher C^estionnaire an att^pt was made to obtain an assessjiient of 
th^ teacher's perspective of issues relevant to the program outcomes. 

Priorities . An identical question to that on the Student Questionnaire 
which asked about the actual and desired emphases on five general goals was 

' 11 
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includt^ in the Teacher Questionnaire with minor variations in wording and 
format (Questions AU Bl, CI and D13), As for the Student (^estionnaire 
both median ratings of importance and discrepancy values could be calculated. 
An additional que'stion asked teachers to rate objectives specific to the ^ 
particular course according to importance^, A problem with this question 
would appear to be that where teachers are strongly committed to a program 
all objectives are rated as very important. \ 

Immediate outcomes . In Forms A and B of the Teacher Questionnaire the 
only information about outcomes sought was an indication of the extent to which 
each objective had been achieved. Form C and Form D were directed to programs 
which were an alternative to part-time study. Accordingly teachers were 
^ asked to J^ate how well full-time students achieved each objective relative 
to part-time students (Form C, Question 2), or the level of attainment of 
pre-employment relative to Stage II apprentices in a number of areas (Form 
D, Question 7). In. each case the purpose was not simply to obtain an overall 
relative rating but identify particular outcomes of each method of study 
to which attention might be given. 

The^^est ionnaire to Rejected Applicants 

A brief questionnaire was designed to obtain basic information from applicants 
who were not successful in obtaining a place in a pre-vocational course. 
The questions are simple and direct and the instrument is self-explanatory. 
A copy has been included in Appendix B. ^ . 

Aptitude and Achievement Tests 



Several problems existed in the evaluation of technical knowledge and 
competence as an inuiiediat el outcome of pre-vocational education. One means 
of evaluating immediate outcomes was through teachers^ overal 1 ratings of 
student performance, as described in the previous section. A second possible 
approach was to make use of suitable test material. Unfortunately there 
were few established tests of achievement suited to the programs under 
review. The development of achievement tests in trade and other occupational 
fields should be seen as an important priority. An alternative source of 
test results was to make use of those student assessments which formed part 
of the programs. These varied in type both between programs and between 
Colleges offering the same programs. Some were very clearly based on the 
concept of mastery learning and criterion referenced assessment, others were 
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not. In one progru mastery testing was used for each section of the j 

program so that a final result was in terms of successful conpletion only. / 

» / 
Many of the iiii!struBents and strategies discussed in this chapter so far 

have been applicable to pre-vocational education in general. The assessment 

of technical sjcills and knowledge is clearly an issue specific to particular 

programs. In the general description of the evaluation framework it was 

mentioned that some issues Hrere general to pre-vocational education and 

others were specific to particular programs. It was argued that thc^ strategy 

could be seen as adaptable in that specific outcomes of particular programs 

could be evaluated in addition to general outcomes of pre-vocatiorial education, 

For this reason the choice of appropriate measures of stiuient achievaient 

, would be a matter to be decided in relation to the particular pi)Ogram« It 

would seem important that any measure ought to Se logically related to 

the intended outcomes of the program in terms of employment or further stpdy . • 

We would not advocate the use of general tests of literacy or numeracy « but 

rather tests of specific skills and knowledge in the occupational area. 

In applying the evaluation strategy to the four programs mentioned, a 
number of instruments have been tried. Though they would not all be generally 
applicable it is worth describing the general features of them. 

' The Mechanical Reasoning Test ' . 

In the study of the t^olytechnical Pre-Vocational Program the ACER Mechanical 
Reasoning Test was tried. This test is designed to assess a person's 
aptitude for solving problems which involve mechanical ideas. It is shorter 
and less verbal in content than the ACER Mechanical Comprehension Test taking 
just 20 miniites to administer. It is not considered suitable for stiKients ' 
taking technical courses at an advanced level, but wo^ld seem to suit 
students of some pre-vocational education programs. Ft has been found to be 
a reliable instrument. Its internal consistency as calculated from Kuder- 
Richardson Formula 20 coefficients has been found to be about 0,8, and a 
coefficient of stability (test-retest) of 0.73 has been reported (ACER, 1979). 
In addition a revised edition with 1977 norms has been released. 

The Mechanical Reasoning Test was administered to students in the 
Polytechnical-^rograiB, It was considered tha^^^such a test suited the geheral 
technical goals of that course. Of course it could also suit many iK>no- 
technical prograxas. Its potential value in such a program is twofold. 
Firstly, as a test of aptitude of apprent:j.ceship training it could be 
considered as a measure of an outcome of a program designed to improve the 
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aptituSe of stu<Snts for apprenticeship. Secondly, it would provide valuable 
inforaation of the aptityde of students entering pre-vocational programs, Sinqe 
it is more closely related to the skills involved in these prograss it would be 
of greater value than general school achiev^ent ^asures or general ability 
measures. In the 1978 trial application of the evaluation strategy it was 
administered towards the end of the year as an outcome measure. Other 
circuastances would permit its use as a pre ^' and post-test instrument and 
enable *gain scores' or residuals of a regression analysis' to be used as 
the out Cone measure. The latter appears to us to be a more useful procedure. 

Eighty-five students of pre -vocational education completed the. Mechanical 
Reasoning Test in 1978. The internal consistency (KR20} was found to be 
0.81 which suggests that it is a reliable test ajiK)ngst^ this group of students. 
It was also possible to correlate scores on this test-with the other 
assessments made of students' performance by teachers as part of the normal 
program. Correlation coefficients have been recorded in Table 6.7. It can 
be seen that the achievement measures which correlated im>st strongly with 
Mechanical Reasoning were those involving Trade Practice and those which 
^ were least 'strongly correlated with it were those involvii^g more general or 
academic subjects. This can be interpreted as evidence that the test was 
measuring mechanical aptitude. It should be noted that the correlation 
coefficients between the Trade Practice assessments and the Mechanical 
Reasoning were only moderate. Clearly^ aspects of a student's ability other 
than mechanical aptitude would influence the skill they showed in the. Trade 
Practice-^ 

» •* 
Chemistry attainment test 

For examining the outcx)mes of the. certificate course in chemistry use was 
made of results obtained by Fraser and Catts (1978) ^rom a test developed 
by Fraser (1978) . This test was designed to tesOihe basic chemical 
knowledge and skills possessed by students entering the chemistry certificate 
program. Students had been tested on entry to the program and at the 
conclusion of Stage II. All full-time and part-time students were tested. 
For full-time students this occurred at the end of one year while for part-- 
time students this stage was reached after two years. As the relative merit 
of part-time and full-time study was an important issue in this program^ 
this information was ext«mely valuable. 



^ The full report by Fraser (1978) provides an example of the application 



of test development procedures. 
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Table 6«7 Corre 1 at i (His between Assessment Results and Mechanical 
Reasoning Test for Prc-Vocational (Polytechnical)^ 
Students 1978 



Com. 


Human 


Trade 


Trade 


Trade 


Trade 


Trade 


Mech. 


Skills 


Rela« 


Prac, 


Drwg 


Science 


Prac. 


Calcs 


Reasoning 






(4) 


(4) 


(4) 


(5) 


(5) 




Comm. Skills 


48 




25 


36 


23 


27 


34 


Human Rela« 




31 


28 


46 


39 


32 


24 


Trade' Prac. C^)^ 






12 


32 


• 35 


27 


43^ 


Trade Drwg (4) ^ 








37 


37 


28 


34 


Trade Sci. (4) 










29 


46 


29 


Trade Prac. (5)^ 






ft 






44 


54 


Trade Calcs(5) 














44 

> 



a Denotes Module 4 
% b Denotes Module 5 
Note: Decimal points have been omitted. 



The Chemistry Attainment Test had been cai'efully constructed /and 
validated. Its reliability \Jas high CKR20 coefficient = 0.80) anfl its 
validi-^y^ seembd good. The test had been revised after item analyses based 
on classical test theory. / 

For our study the New South Wales Department of Technical and Further 
Education made available the results of this test in 1978. Use was made of 
the results obtained by full-time students and the results obtained by part- 
time students in the same colleges as the full-time students, 

Carpentry and joinery 

In the case of the program in the field of carpentry and joinery standard 
tests ^ere not used in all the colleges offering theV^ogram. However, the 
School of Building in New South Wales had developed a series of test items 
to be used in constructing topic tests in each ^f the topics making up the 
program. With the help of a member of the curriculum section of the New 
South Wales Department of Technical and Further Education it wa^ possible 
.to construct a test of knowledge of carpentry and joinery. The test was 
, planned so that it could be completed in one and a half hours. Items were • 
chosen from a grid drawn up to ens*ire that the test represented all topics 
and skill areas in appropriate proportions. The grid has been shown in 
Table 6.8, 



' -9 



■TAble 6.8 Cqnf traction of the Carpentry and Joinery Achievement Test 







Skill 




■ 




Know 2 edge 


Drawing 


Calculation 


Totial 


Cladding 


1 . 




1 


2 


Roofing 


, 1 


1 




2 


Hip and valley roofs 




1 


1 


2 


Joinery, windows and doors 








'1 1 


Steps, stairs and arches 


1 

w 


1 




2 


Safety 


2 






2 


Special joinery and fixing 


2 






2 - 


Materials 


2 




ft 


2 


— — — - — ' — li — - ... — 
Total 


10 


3 


2 


15 



Because the test was constructed quickly it has not been validated or 
extensively tried. In the present study it was administered >t the end of 
1978 to pre-employment students and Stage II apprentices in the carpentry 
and joinery field. In this way it was possible te compare the achievement 
of the two g^ups of students. 

Other achievement data - 

In addition to these tests use was made of the results of the various 
assessment procedures used as part of the various programs. Such information 
is often overlooked, but is ati impertant part of program evaluation. In 
r^the office training the assessment was made in relation to clearly specified 
criteria ai>d was therefore extremely useful in evaluating that program . 

A Summary of the Instruments 

In this chapter a Student Questionnaire, a Teacher Questionnaire, a Career 
Questionnaire and several tests have been described. Throughout the 
description of these instruments attentio*n has been given to the information 
they were intended ^^o provide about each element in the framework. To 
summarize much of the detail three tables have been presented. In Table 
6.9, the data sought about background factors have been, summarized. 
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Table 6,9 A Suyary of Data Sought about Background Factors in | 
Pre*Vocational Education [ ~ ' 



Eleaent 



Student 
Questionnaire 



Teacher 

Questionnaire Other 



Student Motivation 

Career Plans 

(a) Specificity 

(b) Job choice 

School Background- 

(a) Attainrcnt 

(b) Achievffl»ent 

(c) School type 

(d) Experience 

i (e) Reasons for leavipg school 
(£) Pre-requisite sklils 

Ho»e and Social Background 

(a) Socio-econopic status 
Cb) Other fiyg^ily occupations 
(p) Ethnic backgrcHmd 
(d) Peer activities 

Teacher Characteristics 

(a) Work experience 

(b) Education training 

Employwent^ Opportunities 



SQll 



SQ5, 24-27 • 
SQ23 



SQ2 

SQ3 

SQ6-S 

SQ9 



SQ35 
SQ36-4Q 
SQ31-34 
V SQIO 



TQ3 



0 



TQ/Dl-^ 



TQ/ABC3, 08 



Records 



TQ9 
TQIO 



Department 
of 

Employtaent 
Records 



Table 6.10 contains a similar summary in relation to teaching processes, and 
table 6.11 sets out the way in which information "about prograiB outcoaes could 
be sought. 

Administration and Saigpling 

' The Student Questionnaire and tests 
- — »— >- — _ .. * 

A significant problem for the collection of data by »esns of questionnaire 
' from students in post -secondary education is that of attrition. If data is 
collected from students during the year then it will be biased because soise 
students may have already withdrawn. It seems probable that those students 
who withdraw from the course would differ in some respects, such as their 
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Pre-Vocational Educatioiv 






Element 


Questionnaire 


Teacher 
Quest iomiaire 


Other 


Iforking Conditions 


SQ20 


TQ6 




Teaching Methods 


SQ19 


tQ7 




Practical E»|:diasis 


SQ18 


* 


CQ • 


Satisfaction 


SQ17,12,\;3,22 


1 

t 




Difficulties 


SQ21 


TQ5 





satisfaction with the course, fro® thei^ peers who continue. It Seeas that 
^ attrition rates vary considerably between courses and that in soae areas of ^ 
Technical and Further Education they are considered to be a probi^ (BrcHighaa, 
1978). Even th04^gh,iattrition in pre-vocational prograas did not $ee« to be 
large it Ktst be acknowledged as a problem for the collection of data. In 
another publiciition attrition rates in some pre-vocational programs haVe been 
reported. At this stage it is sufficient to note -that sost students who l*ft 
these prograas in 1978 did so to take a job. This observation^not only suggests 
that the term 'dropping cHit» is an inappropriate description of student vfith- 
drawal, but also that the chai^t eristics of those who withdraw may not -be 
xaarkedly different fro® those who continue. 

The consequence of significant attr^.on rates is that some data should 
be collected froa studfents on entry to a prograa. Iji particular data which 
are concerned with background factors sihouid be collected on entry together 
with any aptitude measures related to outcomes. An additional reason for 
t collecting these data at the point of entry to the jirogram is that students 
may not be able to recall accurately their reasons for starting a course, 
or for leaving secondary schopi, etc, by the middle of the year. It would 
seem likely that students would express their reasons fo^ enrolling in a 
way which rationalised that to which they were now committed. 

Similarly it follows that data concerned with processes should be 
gathered during the year, after students have experience of the program, but 
before outcomes are assessed. Outcomes, of course, would be measured at the 
end the year. Thesey^considerations. imply a data .gathering strategy in 

three stages, > 

/ 



ERIC 



125 



^3$ 



Table 6.U A Suwmry of Data Sought About Outcomes of 
Pre^Vocational Education 



Element 



Student Teacher Career 

C^estionnaire Questionnaire Questionnaire Other 



Priorities SQi4 

Immediate Outcomes 

(a) Personal Developiient: * 
'^SeXf-Esteem S.E,I.^ 

(b) Personal Development: 

Occupational Choice SQ2S 

(c) Attitudes: 

Career Maturity CM. I, 

(d) Attitudes: 

Self -Development SQBl-lS 

(e) Technical Competence 

Longer Term Outcomes 

(a) Eajployment 

Characteristics 

(b) Job Stability 

(c) Job Satisfaction 

(d) Retrospective 

Satisfaction 

(e) Success in Further 

Study 



JQ/ABC1,D13 



(B2) 



TQ/ABC2 



TQC2,TQD7 



Tests 



CQ2-5, 12,15 

CQ7-U 

JDI^ 

CQ2i 



Records, 



Coopersmith Self -Esteem Inventory. 

Career Maturity Inventory: Attitude Scale. 



rv 



Job Description Index. - ^ . 

^ Tests tised for each program have been described in the text. 

In the present study all the data' from students were collected at the one 
time. Because of the time at which the project commenced it was not possible 
to gather data from students before September. This was satisfactory for trial 
purposes but we acknowledge the twin sources of bias in the result obtained : 
attrition and rationalization of perceptions. 

In the trial of the Student Questionnaire we were concerned with students 
in a limited number of colleges. In all the programs, except carpentry and 
joinery, we were able to administer the Student C^est ionnaire to all the 
students in the course at the time. Hence the question of sample design was / 
only relevant to the carpentry and joinery program. For that program the 
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Stud6X\3 Questidnnaire was administered to» a sample of students chosen by a 
two stage saapiing process. The two stages we^e: 

1 a random sample of colleges offering the prograia, stratified so that 
^equal numbers of metropolitan and non-metropolitan collages were 
chosen, and . * \ 

2 all the students of the pre-apprenticeship» carpentry and joinery prograa 
in the colleges* sampled. ^ 

r 

This very simple design was followed bec^se all colleges had the same 
number of ca»entry and joinery students and that number small (16). 

In more Isitensive studies of programs* conduct^ in a number of colleges 
more attention would need to be given to sampling. Sampling would be 
important when enrolments were so large as to make the administration of a 
questionnaire too costly. One approach which has been described by Ross 
(1976) is a two stage sampling design in which the two stages are: 

1 a sample of col leges ^ho sen with a probability propbrtional to the 
number oof students in the program under review in thJfc^ college, and 

2 a sample of students (about 20) of the saa^ sfze drawn from each 
sampled college* 

Ross (1976) has shown how the sampling errors involved in such a design 
can be calculated from estimates of the intra-class correlation coefficients 
for an attribute. 

In the present study two methods pf administration of the Student 
Questionnaire were used. For two programs a Rasearch Assistant was employed 
for this gtopose while in the other two the questionnaires were administered 
by college staff. Even though the latter was less expensive the use of a 
Research Assistant proved a far more reliable means of obtaining the data. 

The Teacher Questionnaire 

' — ~ - ^ 

As part of the approach to evaluation the Teacher (^est ionnaires described 
previously were developed. In three of the programs the Teacher Questionnaires 
were intended to be completed by all the teachers connected with the program, 
while in the fourth it was designed for the teacher in. charge of the program 
because of the small numbers in each college. Several methods of admini- 
stration were tried. At some colleges it was handed to each teacher after 
an interview for completion, sealing in an envelope and handing to the program 
co-ordinator , At other colleges it was handed to each teacher at the college 
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with a staapod addressed envelope for direct posting to the researchers. 
^Finally, at a few colleges it was posted to teachers at the college for reply 
post to the researchers. The first two Mthods were successful. ' The last 
.was only successful for the questionnaires directed to the teacher in charge 
of the program. Lack of personal contact between the researchers and other 
staff seesaed to reduce the proportion of questionnaires returned • 

The Career Questionnaire 

The purpose and structure of the Career Questionnaire have already been 
described. It was administered as a mail survey to samples of stisdents from 
three pre -vocational programs. In each case the questionnaire was posted to 
home addresses and re&inder procedures were instituted if a reply had not 
been received after two weeks. In total, three reminders were sent, the 
second being accompanied by an additional copy of the questionnaire. Care 
was taken in the reminder letters to emphasize the need to obtain a reply 
without being too aggressive. The response rate obtained, from an admittedly 
small sample, Suggests that it is possible to obtain .informatioil^ in this way,. 
Re|ponse rates have been shown in Table 6.12. 

For graduates of the Office Training Program in Queensland, questionnaires 
were sent to all students from 1977 for whom addresses were known. In the 
case of the Polytechnical Program, questionnaires were sent to a sample of 
half the students from 1977 as the other half were ^Iready involved in a 
separate study. A simple random sample of fifty former carpentry and joinery 
students was drawn for study in that course. As a consequence, approximately 
equal numbers of former students from each of the three programs were .approached 

The assessment of intermediate outcomes, siKi of enduring outcomes, raises 
the issue of whether longitudinal studies or cohort studies provide the best 
means of obtaining data. Longitudinal studies involve following one group of 
students through their course and career with a series of regular data 
collections » Cohort studios involve the study of different groups of students 
and former students with the assumption that little variation in the 
characteristics of each intake has occurred. The choice involves balancing 
costs and benefits. Cohort studies are both cheaper and provide B^ore 
immediate results, but are based on the dubious assumption of stable entry 
cha»?:act eristics. Longitudinal studies are generally aore sound but do not 
provide immediate results and are expensive. It seemed that the i^haracter- 
istics of entrants to pre-vocat ional education did fluctuate each year so that 
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Table 6,12 Response ^Rates to the Career {^estionnaire 



Office Carpentry 
Training Polytechnical § Joinery Total 



Questionnaires despatched 




56 


c 50 


164 


Questionnaires completed * 










and returned 


49 


52 
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{Percentage response 
• 


85 


93 


70 


83 



longitudina^ studies wuld be preferable. However, in the present study 
which was of one year's duration, it was only possible to use cohorts, 
suppleaented by a little information obtained about those students in the 
previous year/ ■ k 

It seems likely that concern about the privacy of data will grow over 
the next few years. A procedure which was evolved with the New South Wales 
Department of Technical aiKi Further Education provided one means of 
respecting privacy but obtaining information. As part of that procedure 
names and addresses of former stAents were not sought by ACER. Rather ACER 
provided departmental officials with a set o£ guidelines for selecting a 
sample of ex-students and questionnaires to be sent to those p^ple. The 
questionnaires, which had a code number on them, were sent to the respondents 
with a stamped addressed envelope for reply 'direct to ACER. When it was 
time for reminders to be posted ACER provided a list of code numbers not 
returned and reminder letters to be posted by departmental officials. The 
procedure was a little more time consuming than a direct mailing but it 
ensured that personal information could pot be linked to individuals because 
the names and the information were held in separate locations, 

A time sequence 

In the previous section it was suggested that longitudinal studies were 

more appropriate for pre -vocational education than cohort studies. On this 

assumption a time sequence for the collection of data has been suggested. 

1 At entry to the program information related to background factors 
should be collected together with appropriate aptitude measures. 

2 At the middle of the program* information about teaching processes and 
student reactions should be collected. 
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3 At the tod of the prograa student dutcc^iM should be assessed where 
possible in relation td the aptitude on entry, 

4 After one year out of the course information related to intermediate 
outcomes shcHild be obtained., 

5 After foMer students have been ^riy from the program for five to 
years soi^ assessment should be i^de of the enduring effects of the 
program. 

It should be emphasized that while such a research project would last 
a considerable time, valuable information wcxild become available after each 
stage in the sequence. Of course it wmild be possible to translate such a 
tijiipe sequence for a longitudinal §tudy- into a series of cohort studi-es with 
soi^ loss of information. » ' ' 

' In Summary 

In this chapter a mimber of possible' mean^ of obtaining information about 
programs of- pr§.-vocational education- have beeivsiesCribed. Characteristics, 
such/as the reliability and validity, of a numbef of scales and instniiaents 
have been investigated and reported. Yet we have not attempted to be ^ 
pTOscriptive in our recommendations. The techniques we have tried have 
been bffei'ed as but a few of a number of possible approaches to gathering dat 
a few seaaed to be. inappropriate, others needed further modification, yet 
the majority of those instruments we tried seemed^to provide some reliable 
and valuable infqrmation. The important aspect of this chapter is that* 
it attempts to show how appropriate methods o£ gathering data can be 
Yeiated to the major elements of an evaluation framework* It represents 
•the cul«inatioR of a process which began with a consideration of the 
rationale for pre-vocational education and proceeded through a definition of 
important elements of an evaluative framework for pre-vocational education 
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CHAPTER 7 V 
FUHTHER ANALYSES 




iuction 



Itk developing a strategy'for the evaluation of pre-vocational education . 
programs a start was made by examining the main aspect^ pf its rationale and 
the key features of four programs in this field. The results of this, examina- 
tion enabled general approaches to educational evaltialion to be incorporated 
in an evaluation framework fqr pre-voca^onal education. Subsequently it was 
possible to identify the data which needed to be collected about each element 
of the framework and to suggest instruments which might be used for this 
purpose. 

Descriptive data which could be obtained by means of the instnpaents 
described in Chapter Six were considered valuable in^roviding evidence about. ^ 
the way program functioned. Of it«elf this evidence helped portray the 

program in operation ^ could thereby enable better informed decisions to be 
taken about its continuation* The value of accurate data obtained in this 
way is thus both historical and formative. Such data provide a record of 
the program and aids decision making* " ^ 

When' outlining the model of evaluation developed by Stake (1967) it was 
mentioned that evaluation involved 'both description and judgment. Description 
was t#ken to include rather broader activities than simply collecting 
information about "a program. Three components of the descriptive phase of 
evaluation were identified:^ congruence, logical contingency ,\ and empirical 
contingency. Congruence meant the extent to which intentions matched 
observations, and has been discussed as part of Chapter Six. • Logical 
contingency referred to the extent to which it was reasonable to expect the 
intended outcomes to follow from the intended teaching ^rocesse^, given the 
background factors which were presumed. This aspect of the evaluation was 
discussed as part of the rationale in Chapter Two. Empirical contingency 
referred to the relationships between the actual outcomes and the other elements 
of the framework. It is this aspect of the evaluation of pre-vocational 
education, to which a large part of this chapter will be devoted. 

Judgment was taken to involve comparing the program with a set of n 
standards. Appropriate standards could either be an alternative program or an 
ideal set of criteria appropriate to the program under review. The latter 




P*rt of this chapter considers soae o£ the issues involved in reaching 
judgments about a progran. 

Describing Contingencies 

In the previous chapters sose variables relevant to/the evaluation of pre- 
vocational education were identified 'and defined. In brief there were three 
blocks of variables: background factors, teaching processes and progras 
QUtcoses. These three blocks of variables could be tenied antecedents, 
mediators and criteria respectively: It will be recalled that both imediate 
and intermediate progras outcoaes were defined. For the present discussion 
attention will be confiiwd to the inaaediate outcwaes.' ' 

To gather appropriate data to evaluate the relationships between these^ 
aspects of a prograa it would be necessary to undertie a longitudinal study, 
&jch.a lojtgitudinal study would, need to involve students wIk) experienced a 
range of different teaching processes. Probably a saaiple for such a study 
would need to be drawn froa institutions providing different forias of pre- ' 
vocational education in the saae field. Given that pre-vocational education 
is now expanding beyond a few pilot programs this will becoae possible.. | 
However, it should be rei»e«bered that the prescribed curricula for any^-->V^ 
prograa are fairly unifora across colleges. 

It has been argued that prograas of pre-vocational education involve 
■ultiple criteria and multiple predictors. There are several -forms of analysii 
appropriate to such a situation. Even though we- did not collect the long- 
itudinal data ne^^ssary we have outlined one method of analysis which seetaed 
to suit^such a stydy. aJi appropriate form of analysis would therefore need to 
consider relations within each set of variables as well as relations between 
sets of variables. Under these circumstances canonical variate analysis 
would be an appropriate technique (Darlington et al . , 1973). A coffiputer 
program, CANON, developed by Cooley and Lohnes (1971) could be used to perform 
such an analysis. . » 

In canonical variate analysis the first dknonical correlation is the 
largest that can be 'found between a weighted composite of one set of variables 
and a weighted composite of the second. The composites' are the first pair 
of canonical variates. The'^second canonical correlatioiMs the next highest 
correlation between analogous composites which are not correlated with the 
first. Each successive pair of canonical variates can be tested for 
significance. The number of significant canonical variates indicates the 
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Duabdr of dif£ftrent iM^ys in which xim two sets are rtlated« Each canonical 

variate can \k interpretod by seans of the stnu^ture coefficients, which are 

- the correlatioiis betw#m the deriv^ canonical variatea and the original 

^ variables CT^taiwka, 1973), lloreover tim strength of -the association is 

described by the canonical correlation coefficient andi tlw redundancy, or 

overlap between sets « can be obtain^. ^*J^ 

■ • C 

The framework for the analysis of pre^vocational education proposed three 
sets of variables rather than two. Keeves ^(1974) used canoniQal variate 
analysis in a similar study involving antecedent, swdiator and criterion 
vaifiables. Two canonical'^nalyses were i^rformed. The first involved the 
criterion variables as one set and a coibination of mediator and antecedent 
variables as the other set* The second analysis involved the mediator 
vaj^iables as one set ai^ the antecedent variables as the other. From thes^^^ 
analyses it was possible to determine the nature ami tto magnitude of the 
/ relationships between mhi within each set of variables. In fact Keeves^used . 
the results of ttese afialyses to estimate the strength of relationships in a 
path diagram. 

At the simplest level the possible relations between the three blocks of 
variables involved in the framework for pre-vocational education have been 
shown in Figure 7.1. It should be ^phasi^ed that such an approach implies 
a suiaaaative assessiaent in that no account is taken of the recursive effects 
of outcomes on processes, or even background factors such as motivation. 

In the previous two chapters^each of these three blocks of variables 
has been described together with methods of obtaining data. >tore variables 
• were included in those descriptions than wcmld be appropriate in a canonical 
viriate analysis. The purpose previously defined was that of providing a 
full description of the program. For examining ^relationships between elements 
greater parsimony M>uld be required. This is particularly true of the block 
labelled background factors. Table 7,1 contains a list of possible variables 
which could be included in a canonical variate analysis intended to reveal 




Teachi'ng 
Processes^ 



Background - ^ Outcomes 

Factors 

Figure 7.1 Simple Path Diagram: Pre -Vocational Education 
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Table 7,1 Variables for Inclusion In a Canonical Variate ^alysis 
of Pre-V ocational Education — 



Block 



Variable 




Factors 



1.2 Intrinsic Motivation 
Aptitude 

1.3 Socio-economic 

Status 

1.4 School BackgrouiKl 

1.5 Career Specificity 



2 Teaching 2.1 Working Conditions 



Processes 



2,2 Teaching Methods 



2.3 Satisfaction 



3 Outcomes 



3,1 Technical Competence; 
General 



3.2 Technical Competence: 
Specific 



3.3 Personal Development: 

Self -Esteem^ 

3.4 Personal Development; 

Occupational Choice^ 

3.5 Attitudes to Work 



Coments 



1 Background 1.1 Job Motivation^ 



Obtaij}^ by rating of it^ 1 SQll/ 

Obtained by rating of item S SQll. 

Obtained by a test such as ACER 
Mechanical Reasoning.^ 

Obtained from father's occupation. 



Obtained from records at school,^ 
Obtained by answer to SQS, 

Obtained from the score on the 
Working CotKiitions scale 
contained in SQ20. 

Obtained from the score on the 
scale contained in SQ19,d 

Obtained from the complaints 
scale from the Regional Colleges 
Study CSQ17), 

Obtained*" from teacher ratings 

based on categories listed in 
■ TQD7, 

Obtained 'from a test such as the 
Chemistry Attainment T^st (Fraser, 
1978). 

Obtained ,from the Coopersjjiith 
Self -Esteem Inventory. 

Obtained from the occupational 
futures instrument (SQ28) . 

Obtained from the Attitude Scale 
of the Career Maturity Inventory, 
or from another suitable scalers 



Several other means could be used to obtain measures on these two variables. 
One would be based upon factor scores obtained from a factor analysis of 
rosiKJnses to SQll. Another could involve use of an established intrinsic 
motivation scale. . 

This test would only be suitable for some occupational fields. 

In states where a moderated assessment is given in Year 10 it would be 
possible to use those assessments. 
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^ It should be noted thmt this scale was aodified a^r, the trial by deleting 
two itMs. 

* It should be noted" that the practical <®pha5is scale SQIS was considered 
to be not sufficioutly reliii)le« 

Either of these two variables could be incliided depending on the focus of 
the program. ^ would x^t in general be necessary to include both. 

* It should be noted that the CMI attitude scale is a lengthy instrument 
whose factor structure we w^e not able to confirm. Shorter scales 
could be more appropriate. 

the continjgencies between elements. Those included are the variables we 
considered to be »ost relevant in the light of the rationale fcfr pre-vocational 
education. Other studies might make use of different variables and different 
instruaents for obtaining data. However, the outline does provide a basis 
for such modifications. % 

Based on this outline the appropriate canonical variate analyses could 
involve studying first the relations between the set of variables in block 
three and the coiabined set of block two and block one variables, and 
second, the relations between block two and block one variables. From such 
analyses it would be possible to determine the underling relations within 
aj^ between these blocks of variables. 

Judgment ' • 

The second aspect of program evaluation in the -^approach suggested by Stake 
(1967) was that of judgment against a set of standards. It is important to 
not^that judgment was considered to involve the elements described by Stake 
as antecedents, transactions and outcomes. In practice most eva:^uation 
studies have involved judgment of progtam outcomes, and often only one outcome* 
The discussion which follows has been heavily biased towards the judgment 
of outcomes because it se«aed to^be of most interest to Technical and Further 
Education authorities. However, the considerations outlined would be equally 
salient to the judgment of teaching processes, or transactions. 

As previously mentioned standards for judgment might either be a set of 
criteria previously established or an alternative program. These two 
approaches could be considered analogous to ^the techniques of criterion 
references and norm referenced assessment. In program evaluation types 
of criteria cotJld be envisaged: criteria for individual participants and 
criteria for the program. Indeed in some senses the latter represent an 



aggregation of the forw^r. For example* in an office training. program it 
%Kmld be possible to define acceptable typii^ speeds as a^ criterion of 
jindividual success, A criterion for program access wnad then be a defined 
percentage of st^ents succe^ii^ on this tasJk- Similarly, for a pre- 
apprenticeship program in mechaniral engineering it might be possible to 
define skills which shmild be acquired at the coiurlusion of the course by 
individuals, -and set a criterion fot program sixccess in terms of the percentage 
who should succeed in those terms. At a awre general level, gaining 
empioy?Mnt in the field of training could be considered individual success and 
a defined proportion of graduates so employed taken Slndicate program success.. 

Such an approach is feasible for a limited range of program outcomes, 
and is often used for that pirpose in either a formal or informal way* We 
see three main problems in attempting to apply it more broadly in pre- 
vocational education. The first is that it is difficult to set levels of 
attainment for many important goals of pre-vocationaI^educataHS|i. Attitudinal 
goals provide an obvious example where such a procedure would be difficult, 
but th«« are also goals related to knowledge and skills iix which it might 
be intend«r^o provide an introduction rather thmi to develop laastery of a 
skill. The second miin probl^ concerns the setting of appropriate levels 
for program success in terms of the proportion of students mastering an 
objective or goal. It would appear to be arbitrary to ^define such criteria 
as a proportion of graduates to gain employment. The third main problem is 
that a statement of program success in terms of such criteria fails to provide 
scsae Very important information m planning pre -vocational education; the 
iiJ|j|Mj|;ri of the program to the attainment of goals. In planning pre- 

voc)|p^*ioAal education it is important to know the relative effectiveness of 
^i^dff^ent fonns of program in a given field. 

X These difficulties apply to the broad application of criteria for program 
evaluation rather than to cr^erion referenced ass€;ssment of individuals. 
For some intended outcomes the percentage of stmients a^^eving a specified 
criterion would be a useful index of success- However, it seetas better to 
use that in comparison wit^ another group than to attempt to define an 
arbitrary percentage of students achieving success as a criterion - 

In evaluating the effectiveness of a prograa of pre-vocat ional education 
it would often be necessary to employ less rigorous techniques than would 
be accepte^ in experimental research^ As a consequence of employing such research 
designs it is often necessary to acknoWledge the 'threats to internal and 
external validity* which are involved (Campbell and Stanley, 1963). A series 
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of monographs developed by the United States Office of Education discusses 
methodological issues associated with the evaluation of outcoaes of educa- 
tional prbgras$ (Korst, TallBadge, and Wood, 1575). In that series an 
approach to the selection of an appropriate aodel for the collection and 
analysis of data in the evaluation of pi^ogras outcc»ies has been provided. 
The approach was concerned witSi coaparing the prograa under review with 
either an alternative program or a set of norms. In outlining their approach 
the authors set out a seven-step decision tree culaiiuting in five evaluation 
models as follows. 

1 Where it was not feasible to eapioy a comparison group the norm 
referenced loodel was suggested, ^ 

2 Where there was a comparison group to which individuals were assigned 
at random, and where treatment and comparison groups could be matched 
on pre -test scores a post-test comparison of matched groups was 
Jjjlgested. 

3 Where groups equivalent on relevant variables, rather than individuals, 
were assigned to each program, or where individually^ assigned pupils 
could not be matched covariance analysis was suggested, 

4 Where individuals were assigned to different programs according to 
need determined by a test score ^ special regression model would be 
appropriate. r 

5 Where individuals were assigned to a program such that the comparison 
group had superior pre -test score a general regression model would be 
appropriate. 

A subsequent publication in the series (Tallmadge and. Wood, 1976) 
described a more simple classification of three categories: a control group 
category, a regression category and a norm refet'enced category. The control 
group category was considered t;iie most rigorous but as noted it depended on 
the existence of an appropriate control. This category appeared to embrace 
the second and third models above depending on whether students were randomly 
assigned ^to groups, or whether each group was similar on relevant variables. 
The next most rigorous category was that where the analysis could be based 
on regression to allow statistically for the effects of^ initial differences 
between the groups. This category embraces the- fourth and fifth iK3dels 
above. Finally, the least rigorous category of methods was the norm 
referenced approach corresponding to the first model listed above. It was 
acknowledged that for many evaluation studies only this model would 
possible. 
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It is not possible to treat in detail each of the models proposed by Horst, 
Tallmadge axni Wocki (1975) and Tallmadge ami Wood (1976) in this report, 
{^ther we have chosen to refer readers to the original jHiblications, the 
companion volume which is concerned with validating achievement ^ains 
(Tallmadge and Horst, 1976), and the accoiapai^ying series of guide books. 
It i$ woyth emphasizing that this approach to evaluation offers a valuable 
recognition that an appropriate evaluation design depends heavily on the 
circumstances in which a program operates. 

In pre -vocational education several coiparison groups could be considered 
appropriate: apprentices^ young workers, senior school students, and 
unemployed youth. An evaluation concerned with the relative effectiveness 
of pre-apprenticeship and direct entry to apprenticeship might use apprentices 
for comparison. If the main cond^rn was with the general preparation for work, 
comparison with a group of young workers who had not experienced pre- * 
vocational, education would be more appropriate. In a study concerned with 
pre-vocational education as an alternative to secondary school, senior school 
students would be a more appropriate jgroup for comparison. Finally, for a 
study concerned with alleviating the effects of unemployment a comparison 
group of unemployed youth would be more appropriate. In any of the cases it 
would be necessary to use one of the 'regression models' for analysis as the ^ 
conditions for the* 'control group ^xiels' would not apply: there would be 
no random assignment and there would be probably substantial initial diff ereilices 
on relevant variables. 

As part of the development ^jf the strategy for evaluation in pre-vocational 
education some data were coiiecteo. In general the norm referenced model 
was used to guide its collection and analysis. This was because the development 
work had such a necessarily broad focus that it was not pn^miblr t<7 definr 
a simple group for comparison. It was possible to make some comparative ^ 
analyses in the case* of the pre-apprenticeship program in carpentry and joinery 
and the chemistry certificate program, but these were limited and peripheral 
to the study. 

Multiple Criteria 

Procedures for collecting and analyzing data aBout program outcomes generally 
apply to single outcomes, or a series of outcomes treated separately, ^his 
conmient would apply to the procedure described in the previous section, In 
previous chapters of this report it has been argued that programs o*f pre- 
vocational education have several intended outcomes and ought not to be 




judged on the basis of a single outcome. Any evaluation of such programs 
needs to consider J/arious outcouies, and assign relative priorities to each. 
One approach .wijj^ be to report the results obtained for each intended 
outcome separately. Those concerned with policy formulation could then take 
into account the relative iaportance of each outcome when taking decisions. 
A wesknes^ of such an approach is that while reliable data night be provided 
about the achievement of outcomes, the assessment of priorities is made 
without any information for guidance. As a result the basis for deciding 
priorities may not be explicitly stated. In the discussion which follows 
a procedure is offered which would enable priorities^ to be includeft in an 
evaluation in a more formal manner. 

In Chapter Four an approach advocated by Edwards, Guttentag and Snapper 
(1977) was briefly mentioned. That approach involved a consideration of the 
« odds S or probability that goals were achieved, and the ^stakes', or the 
priorities attached to the achievement of those goals. Assigning nvimerical 
values to indicate the priorities attached to the goals was recognized as 
difficult. Edwards, Guttentag and Snapper mention the alternatives as being 
in a 'face to face' group or allowing individuals to list their own priorities 
for later combination. They note the concomitant benefits of the social 
process in a face to face group and cite an example of how that process was ^ 
applied in a particular evaluation Study. An imix^rtant feature of this 
approach was the recognition that different groups of participants may assign 
different priorities to goals. Consensus was not necessarily a goal. Rather, 
divergent values could be used to show how the same data would lead to 
different judgments depending on the values assigned. They conclude that 
this leads to rich evaluation information. 

In the present study an attempt was made to determine priorities by 
means of questionnaire. Though useful information was obtained, this 
procedure suffered because of the tendency of respondents to indicate several 
goals as being very important. A future development would be to use the 
questionnaire method first and tb use the data obtained as a basis of 
discussion in groups to achieve greater discrimination between highly 
valued goals. Notwithstanding this problem, the prbcedure adopted allowed 
the views of a large number of participants to be considered. 

As a measure of the attainment of goals, Edwards, Guttentag and Snapper 
suggested an approach based on probabilities that goals were attained. In 
fact they recommeTidcd a Bayesian approach, though it was recognized that 
alternative methods could be used to derive the same information. Such an 
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aj^toaph supposes that goal ackievMient can be measured dichotoaously; and 
the proportion of cXients achievinfi each goal can be determined. While this 
approach could suit »any evaluation studies it does not seeas universally 
applicable. In many programs it vKjuld be necessary to consider the. extent 
to which a goal was achieved • Consistent with previous ci^^nts in this 
report we believe many of the goals of pre-vocational education should b^ 
assessed on a continuous rather than a dichotomous scale. 

It was noted in l:hapter Fmir that writers such as Carver Xi97S) have 
cautioned against the use of probabilities arising froa significance test 
as an indication of the extent to which a goal was achieved- In that chapter 
the arguments of Cronbach iX97S) and others that the size of each effect 
artiould be reported were seen as appropriate to studies of pre-vocational 
education. Effect size was broadly defined as the difference between two 
measures of the one variable expressed in standard deviation units. It would 
seem useful to include measures of effect size within the general approach 
outlined by Edwards, Guttentag, and Snapper. ^ 

For programs of-pre-vocational education such an adaptation would 
seem to be of great value. The use of effect size^ measured in standard 
^ deviation units would provide that the extent of achievement of each goal 
was assessed on a common scale. . Such measures could be combined w^th 
priority values to give an overall goal achievement imiex, it should be 
noted that to obtain data for such a procedure would require either the 
control group model or the regression model described previously. Note has 
already been made that these models are not always possibly in evaluation. 
If the norm referenced ^>del w^s used it. would «^be possible to refer to 
standard deviations above a norm in applying the approach, but any conclusions 
drawn would be more tenuous. 

Consider an illustration of how such an approach might be applied. Some 
fictitious data have been provided in Table 7,2, Those data refer to two 
imaginary programs of pre-vocational education in the same field. Suppose 
that one is a heavily theoretical prograjH conducted in college, and that 
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where * mean score for treatment group 
X^ = mean score for control group 
S « staiKiard deviation ^ ^ , 
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Table 7.2 All Hypothetical Exajnple 6f Th» Decision Oriented 
Approach to Evaluatio n 



Goal 



Priority 



Program A 
Effect Utility 
Sice 



Proirram B 



Effect Utility 
Size 



Technical knowledge^ 


60 




60 


0,5 


30 


Technical skill^ 


80 




40 


1.0 


80 


Attitudes to work*^ 


50 


0.2 


10 


0.8 


40 


Personal develo^^ent^ 


40 


0.2 


« 8 


0.8 , 


32 


Total prograsi 






118 




182 



^ F^^exaaple measured on a test. 

^ For exaj&ple measured by means of employer ratings, 
c 

For example measured on appropriate attitude scales^ 

the other is strongly oriented towards personal development through, simiiated 
work experience. ■ The priorities expressed represent imaginary values 
assigned by relevant participants in and designers' of the program. They 
have been assigned a value on a scale from 0 to 100. ' 

Achievement of each of th^^ntended program outcomes has been expressed 
as an effect size in stainiard deviation units. Utilities for each goal 
were calculated by multiplying priorities by effect size. Total utilities 
are simply the sum of the individual goal utilities. ; On the ba^is of this 
hypothetical data Program B would be preferred to Program A. We mphasize 
that this was an illustrative example using fictitious data. It has been 
included only to illustrate the way the approach we have ^ggested might 
be applied. 

As the main purpose of this study was to develop a methodology, 
longitudinal data necessary for the use of this technique were not able to 
be collected. Information about priorities was gathered and where 
appropriate, was combined with data about goal attainment. Within the 
constraints o£ the study the tecJinique could not be applied rigorously. • 



ERIC 



141 



In Conclusion ' 

In this filial chapter an att«Bpt has been sade to suggest means by which 
'data gathered about each el^aent in the fra^i^rk could be used in further 
analyses. The analyses have been directed towards an examination of the 
relations between el^ents of the frasoework, and providing iLvidence in form 
suitable for guiding judgment. 

As has been stated in the preceding chapters of the report the outline 
of possible analyses has not been exhaustive. The particular forms of 
analysis adopted will depend upon the roles and goals of a given evaluation 
study. The fonis of analysis offered in this chapter constitute two 
approaches which semed to allow the multivariate nature of ^re -vocational 
education to be examined. 
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APPENDIX A 



SOME NOTES ON A TRIAL OF THE ATTITUDE SCALE ^ 
• <^ THE CAREER MAmiTY INVEmmY 

Background ^ 

The^ Career Maturity Inventory [CMI) is an instruae:(it developed by Crites (1969). 
and published by McGraw Hill, to measure the maturity attitudes, and 
co«^}etencies in making decisions abcmt car^t^rs* Career maturity seaaed to be 
aa important outcome of pre-vocational education. The CM i provides two types 
of measures: the Attitude Scale ai^l the Competence Test* xThere are five 
parts to the C^p^etence Test: 

^el f -^Appraisal 
Occupational Information 
Goal Selection 
Planning 

Problem Solving' 

The Competence test is lengthy involving about 100 minutes. The Attitime" 
Scale teakes only 20 minutes asid is structured around five attitudinal clusters: 



. ^ involvement in the choice process 
orientation toward work 
independence in decision making' 
preference for choosing a. career 
^ conceptions of career choice 

It was planned to examine the suitability of the Attitudinal Scale for 
the study of pre-vocational education- A preliminary trial was comiucted in 
Victoria, and an additional trial was made using pre -vocational students in 
New South Wales and Queensland. 



The Trials 

The Attitude Scale was administered to a sample of 312 young people of age 16 
in Victoria. , Of this^group 123 were in a general course of ^ecohdary 
education at Year 11, 117 were in full-time voational courses, an4 72 were 
apprentices. 

It was planned to examine the differences in scores between the three' 
groups, and conduct a factor analysis of the^ results. In the se^^nd trial 



ERIC 



i S3 



Table Al Scores for Subgroups on the Trial of the CMI Attitude Scale 



Group fkuaaber of Cases Mean Standard Deviation 





— \3 — 


Secondary students 123 34,2 


5.5 


Full-time vocational 117 37.4 


4.7 


Apprentice 72 35,2 


5.1 


All cases 312 35,6 


5.3 


% 




the scale was administered to 165 pre-vocational students 


in New South Wales 


and Queensland, . « 




Scores for Each Sub-Group 


• 


The difference between the mean scores of each sub-group in the Victorian 


trial was significant with the vocational course students 


scoring highest 


and the general secondary students scoring lowest . In general the scores 


were lower than expected on the basis of American norms. 


The results have 


been presented in Table CJ. 




Reliability 




The alpha reliability of* the total score in the Victorian 


trial was found to 


be 0.80. From the second trial a reiikbilij|:y of 0.79 was 


found. Results 


of the test analysis are sh^^n in Table C2 with item-total 


correlations. 


Factor Analysis 





From the Victorian trial the factor analysis proved'^ inconclusive. There - 
were 19 factors with an eigen value greater than 1. A Scree Test suggests 
the presence of five factors. When a five factor solution was obtained the 
factors did not appear similar to those suggested by the underlying theory. 
The factor loadings are shown in Table C3, A factor analysis of the results 
obtained in the second trial was equally inconclusive as reported in 
Appendix - - 
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Table A2 



ItcM, Statistics for the Attitiide Scale of j^e Career 
Maturity Inventory - The Victorian Trial yT 



Itea 


Mean 


Standard 
Deviation 


* 

Iteai-Total 

Correlation 


lt&& 


' Mean 


oxanuaxu 
Deviation 


Correlation 


1 


1.95 


.22 


, .16 ■ 


26 


/ 1.69 ■ 


.46 


-.04 


2 


1.80 


.40 


.04 


27' 


*1.72 


.45. 


.38 


3 


1.95 


.21 


.12 


28 


1.72 


.45 


.21 


4 


1.'84 


.36 


.22 


29 


1.43 


.50 


.14 


5 


1.27 


.45 


' .08 


30 


1.50 


.50 


.14 


6 


f 

1.87 


.33 


.18 


31 


1.90 


.29 


.24 


7 


1.53 


.50 ' 




32 


. 1.65 


.48 


.17 


8 


1.53 


.50 * 




33 


1.74 


.44 


.46 


9 


1.23 


.42 


-.07 


34 


1.71 


.45 


.09 


10 


1.73 


* .44 


.27 


35 


1.21 


.41 


.08 


11 


1.51 


.50 


.22 


36 


1.74 


.44 


' .29 


12 • 


1.91 


.29, 


r 


37 


1 .70 


.46 


.44 


13 


1.41 


. .49 


' .08 


38 


1.92 


.28 


-.01 


14 


1.94 


.24 


.16 


39 


1.54 


.50 


.09 


15 


1.76 


.42 


• 45 


40 


1 .51 


.50 


.17 ' 


16 


1.75 


.43 


.26 


41 


1.78 


.41 


.16 


17 


1.80 


.40' 


.35 


- 42 


1 .8^ 


.33 ' 


.07 


; IS 


1 .74 


.44 


.38 


43 


1 .81 


.39 


.34 


t 

. ^9 


1.70 


.46 


.25 


44 


1.89 


.31 


.28 ^ 


20 


1.60 


.49 


.23 


45 


1.84' 


.37 


. -.05 


• 21 


1.52 


.50 


.12 


46 


1.85 


.36 


.03 


22 


1.86 


.34 


■-.09 


47 


1 .92 


.27 


.08 


23 


1.76 


.43 


.28 


48 


1.73 


.45 


.34 


1 24 


1.95 


.21 


. .25 


49 


1 .54 


.50 


.23 


25 


1.82 


.38 


.29 


50 


1 .93 


.25 


.19 








" Conclusion 






^ 



The Attitude Scale of the Career Maturity Inventory appeared to be a reliable 
instrument but its construct validity was unclear. Further work is needed 
on this aspect o£ the instrument . 
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Table A3 



Results of the Factor Analysis of theWictorian Trial 
of the Career Maturity Inventory Attitude Scale 



Item Factor Loadings 

Factor 1 Factor 2 Factor 3 Factor 4 Factor 5 



(29) 



68 . 
56 

40 

30 
44 



1 




2 




3 




4 




5 




6 




7 




8 




9 




10 


63 


11 




12 




13 


* 


14 




15 


55 


16 


48 


17 . 




18 


44 


19 


51 


20 




21 




22 




23 




24 




25 




26 




27 




28 




29 




30 




31 




32 








34 




35 




36 


... 


37 

f 




38 




39 




40 




41 


36 


42 




43 


'Si 


44 




45 




46 




47 




48 


56' 


49 


% 31 


50 





1 



40 -31 



39 



31 
30 

33 



47 
36 

50 , 

30 •.. 35 

41 

30 



(27) 



W -30 



(29) 

-33 

'35 

32 -31 



Note: Decimal points fiave been omitted and fac^ lo^ding% iCsTthan 0.3 
Q have not been recorded. . 
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APPENDIX B 
QUESTIONNAIRE MATERIAL 



Bl The Student Questionnaire (Section A) 



The Career Questionnaire - \^ 



B3 The Teacher Questionnaire 

(a) Form C 

(b) Alternative Format for Objectives in Foro A 

(c) Alternative Format for Objectives in Form B 

(d) Form D 

B4 The Follow-Up Questionnaire to Rejected Applicants 
B5 Sample letter to Former Students 



Notes 



Only Sectiorf A of the Student Questionnaire has been included. Section B 
consisted of two alternative forms. 

Form Bi The Attitude Scale of the Career Maturity Inventory 

Form B2 ' (a) The Need for Self-Development Scale 

(b) The Coopersmith SGlf-Uste'em Inventory . 

The Job Description Index has not been included with the remainder of the 
Career (^estionnaire . 
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El The Sttident Que stionnaire 



usmuAx cottciL m iwrnwui ksobch 



^ Prg-Afocatiogal Edttcatiojt Project 



Fora A Studeflt {hiestionealfe 



Tilt purpose of this q«w$tio«fiaire Is to Imn a littlt froa stydeats ia larioas coursss why they chosa iimse asersca^ 
lAit tkky think aiMNft their cflirsas, yhat they thi^ aboat work aad what are their plans for the future. ^ 

III thf aaswars yoa give art ^ii(ieatial« Ue are apt going to tell aayoae 'who said yhat^. 

^/itTs'ii^ortaat to aaswr each c^stioa carefully and honestly. 



Leaving Secondly School 



1 yim did yoa leava sec^Mid^-y school! 
(Please give the aoath and the year) 

2 In whit Year or Fora did you leave sacondary school! 
(Please circle one nuaber) 



(aonth) 19_ (ytar) 



5 What typa of secondary school was it? 



k yiien yoa left secondary soitool did you plan to attend a Technical Coll^? 



If y[S, what sort of course were ycHi interested ii^ 



Before finishing Year ID 
Year 10 
Year 11 
Year 12 

Governaent 
Indepm!^ Catholic 
Indepmlent noo-CathoUc 

Yes 
lo 



1 
2 

5 
h 

1 
2 
3 

1 
2 



^ Viten you left secondary scheol did you have a specific job or career in alnd? Yes 

lo 

If WS, please give details: 



6 Did yoa enrol in a TecNiical College iaKdiately after leaving s^i^ry school? 



? Since leaving secondary school have yon coi|)leted any other qualifications? 



EMC 



If WS, please give details: 

(a) T)fpe of (^salification: 

(b) Institutions 



(c) Year Qtalificatioa was obtained: 19 
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Yes 
Ko 

Yes 



Hav« yo4i «rkid^f»U-tia8 for lort tl»n six lopths at any iim sinci leaving 
90C0iidary school btfort GOWMciag yoi^ pres«ftt course? 



No 



If VtSt plwsc give dtfails: 



Thi«k of yoijr decision to leave secoodary sdwol and coflsidef Iww iifHM^3fit each of the following reasons «re in that 
iJecision- Circle 1 if the reasoa ws very inportant to you and 5 if it was net at all inportant. Otherwise circle 2, 
5 or ^, to show that the reason was fairly ii^jortant, of some ii^xjrtgnce, or of little iiportance to you. 



Vtry 

important 



.1 

My results (»rks) were not good enough 

$ciK>ol did not lead to good job opportiadties 

I bad co^}leted the studies needed to enter a Technical Course 

I was not Iwppy at school 

I did not think 1 had emjugh ability to keep m studying 

Hy pareats did not want m to stay at school 

I was tired of school and study 

Hy parents did not think I had enoi^ ability 

I fsad sufficient general education 

I did not like certain subjects 

Hy teachers did mjt think 1 should continue 

I had c(M|}lfited the highest Vear at ny school 



Fairly Of som Of little lot 
ifl^ortant iiportance iin?ortance ieportant 

2 3 5 

2 3 «. ■ 5 

2 3 «• 5 

2 3 <• 5 

2 3^5 

2 3 >* 5 

2 3*5 

2 i-. <• 5 

2 3*5 

2 3*5 

2 3*5 



Your School Friends 



10 Coeld yo« tell us what your best three friends fro« secondary sctool are doing noW? 
(Circle one maber in sach colim) 

Friend A 



Working in 3 job related to this course 

irking in another job 

yne^}loyed 

Studying in this course • 

Studying at High School 

Studying in another fulI-tiie technical course 

I don't know 

Other (Please say ) 



Friend 8 
1 

2^ 
5 

5 
6 

7 



> 



friend C 

1 

2 
5 

5 
6 
7 
8 



$tarti»9 this Cowse 



It 



How liipoftaat are the following te-yoit as reasoiis fqr startiag this' coutsb? Indicats yjHtf ansuer by circIiB^the* 
ippro()fi4tt aiMbcr opposite tacli riasoa. 



Very 
iapo 



To gtt tfaiftingl^^V^ 

To a basic gemral education 

To plaass parsRts 

To fill ia tiw until I dicidt what I want to do 

Ts study in a field that really interests M 

Because a job wasn't available 

Other preferred coiM'ses were full 

To he with friends doing the course •» 

Because an 3|)p'renticeship v3snH available 

As a preludaary course before ejijteing another course 
(e.g. t8 awrenticeship) 

To help detenifle what career I could follow 

NOW GO BACK m UWOERLIHE THE HOST IHPflSTANT REASON FOR m 



■tant 



Fairly Of soM 
important jeportance 



2 
2 
2 
2 
2 
2 
2 
2 
2 
2 



3 
3 
3 
3 
3 
3 
3 
3 
3 
3 



Of little 
inportance 



Not 

iiipoftant 

5 
5 
5 

5 
5 

5 
5 
5 
5 
5 



The CoiTse in G6!>erai 



12 Ho« iatiresting do you find your co4ys«? 

Very boring 
, Rather dull 

Fairly interestif?g 
Very interesting 
Extreaely interesting 

13 \ifti3t is your overall evaluation of your course? 

Vary satisfied with sy course . 
Satisfied with ly course , 
Uncertain 

Dissatisfied with ay criarse 
Very dissatisfied with ,Tty course 
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15 



16 



1? 



2 


3 


it 


5 


1 


2 


3 




5 


2 


5 




5 


1 




3 


i. 


5 


2 


3 


i| 


5 


1 


2 


3 


A 


5 


2 


3 




5 


1 


2 


3 


4 


5 


2 


3 


k 


' 5 


1 , 


2, 


3 


A' 


5 



A, sirliis of thm$ U lUttd bel^* For in^h tbm you are askad to ideate: 

(x) Hotf aucii Mptoiis hss hitn gives to H in ^ coars« tills sod 

(ii) How iMcl3 itt jijur opinion, stoild have be«o given to it this year*- 

i ^. ^ .' " , ■ 

^ Ci) ttmrf Mich «^?tmsis IMS bm 

given to this? 

A little 
^ grtat ftod- or 
deal eratt Sone Slight rvotw 

£^pl)35i5 00 skills, loioidtdge ami te^Mques 
for the prioticA of a future ^ 1 

Development of self-^veraness self^-confidence 
end S2S uoderstandiDg of ot}w ;^lf 1 

Dev«lopaent of attituctes which vlU assist you to 
settle into a job 1 

The al}ility to read, write and use mnbers 1 

Uarniog about our society 1 

How useful is your course for the type of cKici^atiofl you expect? 

Very useful and relevant ... 1 

Fairly usefui 2 

* Hot very useful i .1 3 

Of so«e slight relevance h 

Alaost complete^ irrelevant aod useless 5 

In your present course how well do you do conpared with other students? 

Below awrage 1 

Average ^ 2 

Above avsragt 3 

In top 2CS of class ««• ^ 

Mear top of class 5 

Listed below are some oMments students so«etiies take. Are these true of your course in general? 
(Circle one nuttber in each row) 



(ii) HoM ittcii ^hasis.SHGUlO 
HAfe been given to this? 

A tittli 

at Ho<^ or 
deal erate Soie Slight none 



General work prtssure is too grest 

There is not enough tia^ for study 

There are too Kny hours in class 

There is too nuch eaphasis on vocational training 

Course deiands too iuch aechanical learning and no( such 



iiK^ividual thinkii^ 
Too luch like sec^mdary school 



Strongly 
agree 

1 

1 
1 

1 • 

1 
1 



Agree 

2 

I 
2 

2 

2 
1 



kno\i | 

3 
3 
3 

3 

3 
3 



Disagree 



\ 



Stfonfily 
disagrea 

5 " 
5 
5 
5 

5 
5 
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fkM Practical is the Coorse? 



IS listed below are soae statmnts concariwd with the practical a^cts of courses. Thiry^ atxHit tm mil each 
'ftatawAt (kscribts tht c«irs« yoii art ctoiog* Thert is spacs aloogside each statement to imiicate )[oar an^ier by 
drawiiig s circle arouad om iHii^r is e«;h r&t^ 

* 



Students are More interested in special {^) training 
than a general edijcatioe 

The atiosphere is practical and useful things ^re 
eaphasizfHi 

fejsy subjects stress abstr^t ideas rather than real things 

The cotrses here include lany really practical Si^jects 

Host students are interested in their future ;^bs 

Kany teachers ftress the practical uses of their si^ject 
so that a student say apply what he has learned in a job 

Learning to work with others is important here 



Str^ly 
agree 



Agree 



know 



Disagree 



StrcH)gly 
disagree 



Teaching 



19 Thinl( of a typical teacher (lecturer) at your college who is neither 

Indicate whether you agree or disagree with the foUowif^ stateients 

opposite each itaiu Circle 1 if you agree strongly with the stateaen' 

circle 2 or Mo show that you tend to a^ee or disagree, amJ circle \ 



best nor the worst in your experience* 
abiHit hiji/her by circling the appropriate nuMb^ 
and 5 if yc^ disagree strongly. Otherwise 
only if it is really iipossible to decide* 



Uses everyday practical exaeples of topics discussed 

Provides soee worli for students which is siiilar to what 
they would do when they finish t^^ course 

Sets tssks which are useful and satisfying 

Discusses the relevance of topics for our s<K:iety 

Discusses the usefulness and relevance of each topic for 
later work 

States clearly the purpose of each piece of work 
Explains 'things clearly at the students. level 
Enables you to work at your own pace 
Gives enough tiie to coeplete a job 
Sets deadlines for work to b€ c^ipleted 
^tively involves students in lessons 
Has iotivated you to do your best work 
Treats students as adults 



or^ly 
es 



Agree 



Don't 

3 

5 
5 
5 

3 

5 

3 

■3 

3 

3 

3 

3' 

3 



Disagree 



Strongly 
disagree 
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15 (cofttijiiri) 

Eimr^s studsiits to be re^imible for their actions 
Stttfts clmly the staixtords uhj^cb ars sxpecttd of studeists 
Provlc^ 3 lot of information ab^ut your progress 
Lets yoir selact topics, prc^I^ &ml exsnples 
Eocourages stiwkats to co-op«rate with t^jh other in jobs 
Encourages studeots to think abmit their future life 
Sequlrss correct spelling aiKl expression in written vork 
Require^ accurate calculations with iHMRbers 



Strongly 
aqree 



I 



Oon^t 



2 
2 
2 
2 
2 
2 

2 



3 
5 
3 
5 
'3 
3 
5 
3 



Strongly 

disagree.'' 

5 
5 
5 
5 
5 
5 
^5 
5 



You and Vour Vork 



20 Consider th# following statements itmt a^cts of typical ^i^king conditisHJS. Compare y«r working cwJiti««5S with 
what m think the wof kimi conditions would bQ like for: 

(i) a student in a secondary school, and o • 

(ii) someone in full-time eti^loyttent. ' 

- ' (Circle one number in each row) 



Responsible for ones own work 

in College 
in work 

in High School 

The J3bs and activities are worthwhile and useful 

in College 
work 

in High School 

Being asked to decide how the job should be done 
» in College 

in work 

' in High School 



Being treated as an adult 



in College 
in work 

in High School 



Never Rarely ' Sometimes Often 



2 
2 
2 

2 
2 
2 

2 

2 
2 

2 
? 
2 



3 
3 
3 

3 
3 

3 ., 

3 ^ 

3 

"5 
3 , 
3 



20 (cofttti^) f 

ttiig tblt to work with upHtoMckti iquipMit . 

in Collect 

is Hi^ School 



fulias part of a tsaa 



is Collegi 
in work 



Hewer 8aftly Sowtites Oft«n 
4 



in High School 



1 
1 
1 

1 
i 

1 



\ 



Problens 



21 In this qucstisn we are iat«rested in general proble* areas you light have in yoiir coiirse and »4jether you have had 
- taough help with thet. 









Difficulties 




- Help 










Generilly 


Generally 












yes SoMetises 




Enough Sone 


None 


Kathftiatics 




t • • 


1 Z 


3 \ 


1 2 


3 






■ • ■ • ■ 


1 2 




1 2 ' 


3 


^^itinj** 


■ • • « 




1 2 


3 




3 


Poetical skills 






1 2 


5 


1 1 2 


5 


Oth«r (i«scrib«) 


• « • * 


> • • « « 


1 2 


■3 


1 2 


3 



22 In this question like to know abcirt so«e of the siibjects or activities ii^ich you do in the coufss. 

Is the s^3acc provicfed list the subjects, or activity, wliich matches the description provicfed. 



Host difficult 
Requires mpst work 
Easiest 

Heist interesting 
Uast intssting 
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ChoosinQ a M 



23 



2^* 



How iiportant irs each «f the follDuiog id ohoasii^; a pcmanent occupation? 
(Circlt OM MMber ii^ Hch roy) 

Very fairly 

* ■ ■ ^ iw j xytaRt iiportant 

There is good pay 
The oppcrtuaity to work otttd^ors 
It is iateresting work 
The occiipatiop is useful to the c»w*nity 

■jtorkipg with people . • j 

I 

tttt occupation hasThlgh statijs io the coMunity 
Th^re is good opportunity to travel 
tieJIiipg oth|Br people 

It i^ ati occijpatioo yith security ^ 
The work is satisfying 
Being ly own boss 

The occi^ation has good working conditions 

I 

i • Your Iwnediate Plans 

How definite are your plans for a job? 

I have a job arranged for when I finish the course 
I know exactly the kind of job I want 

I ai trying to decide between two or three different kiiKls of jdis 
I ai consideriflg sore than three different kimis of jobs 
I do not have any specific jobs in »ind at this tiae 
If you have a job arranged please describe it: 



Slightly 
iiportant 



£ 


5 


Z 


5 


£ 


5 


2 


3 


z . 


3 


2 


1 3 

■ 




3 


2 


3 • 


•2 


3 


2 


3 


2 


5 


2 


3" 



Kdt at sU 
iwportant 



1 

i 25 If a job becase avBilable during your course would you leave the course to take it? Yes 

No 



If VtS, please give details: 
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26 How ^ difflciat (te, yoil titiok It. will be to get 3 job suitable to y<H«' traiui^ when ^ bas^ finisf^d 

Does wt ipply (I h3V« a j<* arrai^jed) l 

^ I Vtry tasy ... 2= 

. ^. fairly ta^ ^ 3 

' J| ' Very cliff icult ' ^ ... ; ... 5 

2? ^jSiBA was ^our choite isf future job iade? 

Ko clioice as yet • ... "... 1 

Vrfhilc priwry school ... ... 2 

4 tthile k secomiary school ••. ... 5 

At the ti«e of coiipletiog seconc^ry scl^ol, ' ... a.. k 

After being unafale to get i^to field of first choice > , 5 

Soie tiae after "starting in the present c(^rse - ...^^ 5 



Your Future Possibilities ' 

28 Vfe would like you to think about soaie of the jobi^ou might do, 

- List all the jobs qr occupations you cmild do and'i^id like, if. you were able to undertake , the r^cessary 
training, and if )04i could get that job wt^n you finished your training. 

- list as «any jobs as you can, but cbn!t^feel you have to fill every space. 

I 4puld do and would like the folloying kinds of jobs: - v 

a 
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Finally, in this stction we would like you to give us s(» inforiation abmit )fOU and your cpursa. 
/29 Ukat is yoiiT sex? 



30 Y(Hir age? . ^ ' Vears 



.31 In wHich coaatry wire j^ou bom? 

32' In which country was youf father bsH^n? ' / 

53 In which coujitry was your nether born? ' 

3^ How loj^ have you lived in Australia? ■■ Vears 

In the followiflQ questions, please Jist the jobs of the people indicated, if ys^ are able, please be as precise 
and detailed as pi^ssible (e.g. »chii>e operator in a Uitter facti^y, seni(^ Glerk in a state goverjwwnt jfepartaeot, 

i- self-^iployed accoimtant). 

^ - ■ • 

35 Vour father's (or tale guardian's) occupation at present • ' 

36 Vour iother's Cor female guardiali's) occupation at present 

37 The occupation that you would like to have in 10 years tiiw . 

58 Ihe occi^ation that you really expect to have in 10 years tiie . ^ 

39 The occupation of yoiir eldest brother. ' . 

^0 The occupation of your eldest sister ^ ' 



In conclusion, we would like to know your and address through which we iight write to you next year vh&n 
you have started work. 



Your nase: 



4 

Your address: 



Thank you for your help* ; 




B2 The Career (^estipnnaire # 

AUSTRALIAN COUNCIL FOR EDUCATIOfiAL RESEARCH 
* PRE VOCATIONAL EDUCATION PROJECT 

1- 

I Career Questionnaire 

Last year you were a student in a fuU-tipe Technical College course. This 
questionnaire is part of a research project concerned with courses similar 
to the one you studied, ' I 

In this questionnaire we would like you to answer some questions about 
your present occupation. * ' 

Please answer these c^uestions within the next few days and send the. ^ 
questionnaire back to us in the envelope supplied . 

i- 

All the information you provide wili be kept CONFIDENTIAL . Only the staff 
working on the project will see it. There is no need to record your name 

V 

For most questions you will heed to draw a circle around thd number next 
to the answer you choose, Fotj a few questions you will need to write your 
iinswer in the space provided below' the question, 

YOUR FIRST FULL-TIME JOB 
. 

1 Have you obtained a full-time job since finishing your course last year? 

Yes ; * 1 

, No 2 

IF NO. CO TO QUESTION 12. 



IF YES, CONTINUE 



What was your first full-time job after finishing your course last Year? 
.(include temporary jobs while waiting for your career job, if they were 
fulUti»e)/ 




3 How many months after you ^finished the course did you spend looking for 
this (your fii*st) job? 

Months . 
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How did you finaUy get this (your first) j< 



^7 



CoMJonwealth Eaployment Service . • , , . . 1 

. Through personal contact (parents, friends, relatives ) 2 

Answered an advertisement in a newspaper 3 

Applied direct to fina/factory ,,,, 4 

CoHSserciai eiapioyment agency 5 

College staff, counsellers > . 6 

^ Other (please describe ■ , . , T 7 

, Lj : ' ' 

Did you consider that your first job was in your field of training? 

4i • • •: • • • 1 

No . , ; . * 2 

■f ■ 

Are you still working for your^first employer? 

Yes 1 

No ; 2 

* * * 

IF YES, GO TO QUESTION 12 * 
IF. NO, CONTINUE! 




/ CHANGES SINCE YOUR FIRST JOB 

How many jobs have you since finishing your course? 

One job^ ^ . . . . , 1 

Two jobs i 2 

Thrfee job^ , 3 

^tore t-hari three jobs ^ 4 

r 

Please describe the sort of change or changes you have mad^^ with regart 

0 

to your emproynient since starting your first Job. 

Change ^ ^ ^ 

Reason ^ 

^ Change 

^ ^ — — ^ ^ , ^ 

Rea^son 



V 



Are you in the sas» kind of votk as when you started your first job? 

Yes .:Tr r... 1 

No : 2 

I am now unemployed .\« « , » 3 



10 



11 



Which of the following best describes *the type t>f work involved in the 
jobs which you've had? 

All involved the same kind of work ^ 1 

^ My present job, and my first job are siinilar but 

between the«^ I have done r^|(^hin^ di^erent V,.,- 2 

I m at present unemployed • 3^ 

Consider your usost T*ecent^ change of emplo^ent (it may your only 
change of employment). ^ " *^ , ^ 

How important ^yvere the following influences/considerations for yoiir * 
most recent change? PleaSe^ indicate by circling the^appropriate number ^ 
how important each of these reasons was in your decision. Circld 1 if 
it was very important, 2 if it was important, 3 if it ikas slightly^ 
important, 4 if it was relatively unimportant, and 5 if it was not at 
all important. . * 



A job with better pay arose 
Management (Boss) was difficult^ 
Unhealthy working conditions 
Unfriendly atmosphere 

Dismissed (Firm closing or retrenchment) 

Dismissed (other reasons) 

No responsibility ^ 

Job not in my field of training 

Not doing as well as friends 

Boring town and people 

Wanted to do njore useful work 

Wanted to fellow a new interest 

Lack of family encouragement 

Other reasoVis (explain * 



-*-» 

c: 
ro 


-M 
>^ c 


rtarrt 


w—1 

CQ C 


-t-t 

8- 


■** 

^ t_ ' 

^3 & 


o 

g- 

• 1-4 
C 

_u 


ro c 
o 

^ i- 


2 


3 


4 




2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4' 


S 




3 


4 


5 


2 


3 


4 • 


, 5 


2 


3 


4 


5 


2 


3' 


4 


5 


2 


3 


4 


5 


2 


3 


« 
4 


5 


2 


3 


4 


5 


2 


3 


4 


5 
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NOW GO BACK AND UNDERLINE THE MOST IMPORTANl' INFLUENCH FOR YOUR MOST 
RECENT CHANGE. 

174 . i 



YOUR PRESENT OCCUPATION j- \ % 

^ \ 

12 (a) Which of .these best describes your present occupation? 

• Working full-tiioe in a permanent job 1 

^ ^ ' ^ Working full-time in a temporary job 2 

• Working part-time 3 

'Working and training as an apprentice 4 

i ^ Not employed, looking for work 5 

^ ' I Not employed, not looking for work ...... 6 

Home duties-. • 7 

' Full-time study ....... 4 * 8 

» • Other (describe ^ 9 

' ' . • ) 

^ (b) If you are working at present, could you describe your job? 

Please be as specific as possible (e.g. receptionist in a dental 
r surgery, apprentice carpenter, postman), but there is no need to 

^ tell us the firm you work for. 

1% 



J 



J3 Do you consider that your present job is in your field of training? 

Yes ; ^ 1 

♦ No 2 

Does no?apply J 3 

14 If you are unemployed, how long is it since you last had a fulT^-time job? 



Less than 1_ month ^ "^^^I^ ' ' * ' ^ 

Betwe'fen 1_ and 'h_ months . . . ' ^ .^ . . . .... 2 

' Between 3^' and ^months , , . .H! 3 

More than 6^ months 1 \ 4 

Does not ^pply , 5 



< 
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IS 'if you wer« to add together all the time t^&t you have been unemployed 
since leading school, how many months would that be? 

^ Docs not apply l 

A total of less than 1 month 2 

A total of between 1^ and 3^ months 3 

A total of, between 3^ and 6^ months 4 

A total of ipore than 6^ months \ ' 5 

HOW DO YOU FEEL ABOUT Y(XJR JOB ? 

y 

Job Description Index 

People in full -time employment: Please describe your present job in the 
following tem^ without regard to any course you laay be studying. 

Unemployed people (or people in part-time employment): Please answer with 
respect to your last regular job. 

In the following 5 question^ describe your work , the supervision you are 
given, the people you workVit;h, the pay you receive, and your opportunities 
for promotion by circling the appropriate number to answer ^Yes', or 
•No* to each item. Circle I to answer 'Yes' if the item describes the 
particular aspect of the job (e.g. work, pay, etc.). Circle 3 to answer 
'No' if the item does not describe that aspect, or 2 to answer if you 
cannot decide. 



Then followed as Questions 16 to 20 the five subscales of the Job 
Description Index developed by Smith (1965) and reported in Robinson et al.". 



(1973) . 


The number of 


i'Vems in each subscale are as follows 


16 


Work 


18 items 


17 


Supervision 


* 

18 items 


IS 


People , 


y items 


19 


' Pay ^ 


9 items 




Promotions 


9 items 
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A siiaiple item from each sub scale has been included here 



Yes 



16 WORK 
(a) Fasciiilting 

17 SUPERVISION 
(m) Knows job well 1 

18 PEOPLE 

(a) Unpleasant * ^ 1 

19 PAY 

(a) Income adequate for normal purposes 1 

20 PROMOTION ^ 

(e) Good chance for prcsaotion 1 



No 



YOUR COURSE LAST YEAR 

wdlild like you to consider how well your course last year prepared 
fpr work, A number of aspects of courses,, taken by students before 
starting vork are listed below. Please indicate by drawing a circle 
around on^ nuiober in eaoh row how wel^ your course prepared you in 
each of these aspects. 




The skills, knowledge and techniques 
in my job 

Self awareness and self confidence and 
understanding other people 

Attitudes in fettling into a job 

Basic skills of reading, writing and 
calculation 

General knowledge of society 
Experience of what work is like 
Knowing how to obtain a job 
Experience of ^working under pressure 



Very 
Well 



Well Fair 



Very 
Poor Poor 



2 
2 

2 
2 

.2 
2 
2 



3 
3 

3 
3 

3 
3 
3 



4 
4 

4 
4 

4 
4 

4 



5 
5 

5 
5 

5 
5 
5 
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is,? 



22 Please write down any other comaents about your work or your course 
last year. 



ThaVtk you for your help. 



f 

* 

17.8 

iS4 




_ B3(a) The Teacher Questionnaire: Form C 

AUSTRALIAN COUNCIL FOR EDUCATIONAL RESEARCH 

Pre-Vocational Education Project 

Teacher QuestionnaiTe 

The purpose of this questionnaire is to learn from teachers what they think 
about some aspects of the course they teach. 

All the answei^ yQu give are confidential. 

t When you have completed the questionnaire, place the questionnaire in the 
^ envelope provided and seal it. 



For each 



A series of issues in courses such as this are listed below, 
theme you ^re asked to indicate 

(i) how much emphasis has been given to it in the course this year, 

(ii) how much emphasis, in your opinion, should have been given to 
it this year, 

Indicp^ your answers by circling the appropriate numbers opposite each 
issue. (Circle one nunier in each row.) 



A great 
deal of 
emphasis 



Moderate Some 



Not 
mich 



Little 

or 
none 



(b) 



(c) 



(d) 



(e) 



1 

-^^^hasis -on skii^^, 

. knowledge and techniques 

for the practice of a 

future job 

Has 1 

Should have . . 1 
Developments of self- 
awareness and self- 
confidence and an under- 
standing of other people 

Has 1 

Should have . . ,1 
Development of attitudes 
which will assist students 
to settle into a job 

Has /. 1 

Should have . . 1 

The ability to read, write 

and use numbe'rs 

Has 



2 
2 



4 

4 



5 
5 



Should have 
Leaiming about our 
Society 

Flas 



Should have 



2 
2 



2 

.2 



2 
2 



4 
4 



4 
4 



4 
4 

i 

4 
4 



5 
5 



5 
5 



5 

5 



For the Cheinistry ^Certificate course there are a jiumber of objectives 
speoified for each subject in^tage I and II. On the ^following page 
there are soma abridged statements of the main objectives. Could you 
please indicate the extent to which you think the objective i s important ^ 
and how well you think full-t^TO students perform in comparison to 



part-time students . 
* be tog precise) . 



(Note: Please give your est imates , . do not try to 
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^ iaportant How well do full^-tiuie 

this objective? . students achieve this 

objective relative to 
Objective part-time students? 
i ^ Very Soae Little Not 
imp, im. im>. iism. Better Saroe Wprse 

V naster a nuaber of 1 2 3 4 *1 2 3 

f.i«ediately useful 
. I ^ora^ory skills ^ 

- develop a knwledge of • 1 2 3*4 1 2 3 
laboratory procedures 

and safe woricing practices 

- develop a good under- 1 2 ^3 4 I 2 3 
standing of General • 

Chemistry ^ 

- provide an under- 1 2 3 4 1 2 3 
standing of relevant 

aspects of physics 

- develop the mathe- 1 2 3 4 17*3 
matical skills and back- ^ ~ 
ground needed by a 

technician 

- develop a favourable 1 2 3 4 1 2 .1 
attitude to, and interest 

in, the student's 
vocation 

isprove vocational 1 2 3 4 1 2 3 ^ 

competence by developing^ 
basic comunication skills 

- (develbp the ability to 1 2 
work rapidly and accurately 
in a laboratory) 




1^ 
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sted helou are a niuaber of difficulties which soaie students have when 
they begin a work preparation course. Could you 



\ 



(i) s indicate the extent to which these were problems for your 

students when they began this year, and 

(ii) * indicate the percentage of students for whoa you thought this 

was a problem? ^ 



1. 



Extent of Ptobles 



Consider- 
able Moderate Slight 



None 
i— 



Percentage 
Students 



Problems of reading at a 1 
sufficiently high level 

Problems of spelling and 1 
written expression 

Problems of performing 1 
mathematical calculations 

Problems of verbal express- 1 
ion 

Problems with manual 1 
dexterity 

ProbleBis of co-operation 1 
with teachers 



r 



4 

4 
4 
4 
4 



Problems of co-operation 
with other students 



Problems of motivation. or 
interest in work 



Problems arising from a 
lack of basic scientific 
knowledge ^ 
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4 Please indicate the extent to which you think the following factors are 
ia^ortant -^or students to be successful in this course. 

J' ' Very Of little Not 

'' ^' ; ' la^ortant Importaftt iaport- iaportant 

■ ^ ance 



Level of ability in written 1 


2 


3 


4 


expression 






• 


Level of matheaatics ability 1 


2 


3 


4 


Breadth of general knc^ ledge / 1 


2 


3 


4 


2 


J 


4 


Desire tb qualify for a good job 1 


2 


3 


4 


Interest in the course , - 1 


2 


3 


4 


EiQotional stability 1 


2 


3 


4 


High intelligence 1 


2 


3 


4 


Persistence 1 


2 - 


3 


4 



Are there any areas in which you think students from secondary schools f 
are not as well prepared to this, course as they should be. (Consider 
subject areas ^ general skills and knowledge and attitudes.) 

(i) , Area 

Coinment 

(ii) Area ' 
Consnent 

(iii) Area ; 
Corpiaent 



1S8 
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In answering these questions we w(3^1d like you to ^compare the worj^ng 
conditions of students in the course with the working conditions 
experienced by sosieone in full-time employment. (Circle one number in 
each row.) . 



Never Rarely Sos^times Often 



Respdhsible for one^s work 

'\/ In college ........ 

In work 

The jobs and activities are 
worthwhile and useful 

In college , . . 

In work 

Freedom to decide how the job 
should be done 

In college 

In work 

Being treated as an adult 

In college 

In ^ork 

Being able to work with up-to-date 
equipment 

In college ....... 

In work 

Feeling 1||art of a team 

In college 

In work 



2 
2 



2 
2 



2 
2 



3 
•3 



3 
3 



3 
3 



3 
3 



3 
3 



4 
4 



4 
4 



4 
4 



4 
4 



V 

/ 



r 



Usted below are a nuaber of stateaents concerned with the teaching of 
full-ti«e pre vocstiQJial courses. Goyld yo'u indicate how iaiportant each 
is in the subjects you teach (i.e. your preferred practice) and the 
extent to which you are able to actually use tjbis aethod in practice. 



Mostly Frequently 



The purpose 
piece of work 
explained clearly 



irk^ 



each Shoul^d be 



Actually 



2 

2 



SoBie- 
times 



Seldos 



3 
3 



4 
4 



Never 



5 

5 



Things are expld^ed Should be 
at the student level Actually 



Practical everyday 
exaaaples of topics 
are used 

The usefulness and 
relevance of each 
topic for later 
work is discussed 



Should be 
Actually 



Should be 
Actually 



1 
1 

1 
1 



2 
2 

2 
2 



\ 



3 
3 

3 
3 



3 
3 



4 
4 

4 

4 



4 
4 



5 
5 

5' 
S 



5 
S 



Students do tasks 
which are useful 
and satisfying 



Should be 
Actually , 



2 

X 



3 



4 
4 



Students are able 
to work at tjieir 
own pace 



Should be 
Actually 



2 
2 



3 

3 



4 
4 



S 
5 



Students are expect- Should be 
ed to meet deadlines Actually 
for work to be 
completed 



3 
3 



4 

4 



5 
S 



Students are 
treated as adults 



Should be 
Actually 



3 
3 



4 
4 



The relationship 



Should bo 



between .students ajid Actually 
staff is friendly 



3 
3 



S 
5 



Stui^ents do some Should be 
work which is Actually 
similar to what they 

would do when they ' ■ , 

finish the course 



S 
5 



Students are Should be 

encouraged to Actually 
co-operate with each 
other 



3 

3 



4 
4 



5 
S 



The relevance of Should be 1 
topics for our Actual ly 1 

society is discussed 



2 
2 



3 
3 



4 
4 
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7 (contd). 



Hostly Frequently 



tlses 



Seldoa 



-U 



Stiidohts hav6 learn- Shoijid be I 
ing experiences Actually 1 
which are valuable 
in themselves 

Assessment is in Should be 1 
relation to a Actually 1 

standard (criterion) 

Students receive Should be 1 
inforniation «|bout Actually 1. 
their progress 
frequently 

Extra assistance Should be 1 
is provided for Actually 1 

slower students 



2 
2 



2 
2 



2 

2 



3 
3 



3 

3 



3 
3 



3 

3 



4 
4 



4 -1 



4 
4 



4 
4 



S' 
5 



5 
5 



5 
5 



S 
5 



Guidance about Shoul'd be 1 
finding jobs is Actually 1 
provided to students ; 



2 
2 



3 
3 



4 

4- 



Would you mention any areas where the difference between what should 
happen y^md what does happen is greatest and indicate the reasons for the 
discrei^ancies (e.g. lacK of time, lack of training, lack of Resources)? 



Coi^id you provide soiae details about yourself? 
9*1 The subject (s)' you teach 



'9.2 Your sex i 

■ •. ' ■ / ■ " 

9.3 Your general feeling about* the' course 



^ 18S 
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9 (contd) 

9.4 , Your-sualifrcations 



9,5 Your work before teaching (indicate jobs and hcHtf long) 



9,6 Hie length of time you have been teaching 



5 soJ'that . i.i 



10 Finally^ could you record your paiae s2>'that if we asV for other infoncation 
froffl yoU'We can put it with this? 



2 
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B3 Form D 

' TEACHER C^ESTIONNAIRE ^ ^ 

»• , 

PRE-EMPLOYMENT CARPENTRY AND JOINERY COURSE . 

This questionnaire is part of a study of full time work preparation cc^tses 
in technical colleges. Its i)urpose is to find out from the teacher in charge 
of Carpentry and Joinery a little about the pr^-employment Carpentry and 
Joinery course. 

All the answers you give ame C0NFID£NT,IAL, Neither colleges nor individuals 
will be identified in any of the reports arising fr9B this study. 

We have asked for the name of your college only so that we can contact those 
colleges from which we do not i^ceive a reply. ^ ' 

Name of College - i 



4* 



SELECTION AND ADMISSION OF STUDENTS 



1 How many students applied for a place in the pre -employment 



Carpentry and 5oine?y cours^ in your co^llege which started 

at the beginning of J9-78? (If more than one group commenced, 

include all groups) ' 

*^ * r ' ■ , ' # 

How many stAidents liere admitted to a place' in the pre'- 'g 

'employm^t Carpentry and Joinery douVse in your college 

at the beginning of ^1978? ^ ' ^ 

- ^ 

Could you please describe the procedure used in selecting 
students for a place in the Carpentry ^and Joinery course? 
Please be as specific as possible by indicating the various 
stages involved in selection". If interviews were, used, 
please indicate the main factors which were considered. 
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If school records are available could you record the students 
School Certificate results on the table on the* la§t page. 
' (Please note that naj^s are required) 

f 



Information available 



Information jiot available 



□ 



WITHDRAWAL FROM THE CCHJRSE * 

How many students have discontinued the course since it 
started? 

Could you indicate the occupational destination of those 
students who have left the course before completion? • 
(e.g. apprenticed, workiiig in hardware store, returned to 
school, not known) , 



1 
2 
3 
4 



STUDENT PERF0RMAM:E 

Could you indicate your judgment of the level of attainment of pre- 
employment students after 36 week§ c;pmpared to stage II apprentices 
in each of the following areas? 



erJc 





about the 
better same 


■ - 

worse Conuaent 


'Knowledge of relevant theory 


1 2 


3 


Skills in building 


1 2 ■ 


3 


Ability to work quickly 


c 

1 . 2 


3 


Keenness and enthusiasm 


1 2 


3 


Able to .adopt to a new 
situation 


/ 

1 2 


3' 


Independence 


1 2 


3 


Maturity 


1 2 


3 
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Listed below'&re m mwiber of difficulties which soae students have 
when they begip a wrk pt«|Miratioa course.. Could you 

(i) •indicate the extwut to which^hese were problaas for your 
stud^ts when thej^ l^gan this year » and 

(ii) in^cate the percentage of ^students for whoa you thought 
^is was a probl^? 

Exteiytr of Problem 



.Consider*^'" * Percentage 
able ..-"^^ . Moderate Slig ht None students 



Problems of reading/ at a 
sufficiently high JeyeJ 1 

Problems of spelMhg and 
written exprej^s'Lon 1 

Pr9bleas ^ performing ' 
mathematical calculations 1 

Problems of verbal 
expression / " 1 

Probl^pms with mjmual 
dext'erity/ ./ f 

/ / 

Problems^ of co-operatioit 
^ith teachers 1 

Problras of co-operation 
with7other^|tudents 1 

Problems' of motiyati'on or 
interest . in work ^ 1 

Jther (|^lea^e specify)' 1 



2 

2 

2 

2 

2 

2 

2 

2 
2 



3 

3 

3 

3 

3 

3 

3 

3 
3 



4 

4 - 

4 
4 
4 

4 ■ 

4 

4 
4 



COURSE STRUCTURE 

^9- What ADVANTAGES do you see in full-time pre^-employment training in 



this, course compared to a full apprenticeship? 



10 , 'What DISADVANTAGES do you see in full-time pre-employmfcnt attaining 
in this course compared to a full apprenticeship? 

. — — — -■• — ^ /■ 

. ' . . . ■ y 
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^95 



11 



12 



On average how much tise is spj^t each week working on< 
the construction site by eacfe group qf ^sti^eiits? 

In your opinion should rao/h tis» be availably for the 
constnictidn probject? / , ^ ' 



days 



13 



A series, of i^^ues in course^ such a^ this are listed below. For 
each theme ydu are ask^ to indicate . ^ ^ 

.(i) how mch emphasis lias been given to it in the course this year, 
(ii) how^ffiuch emphasis, in your opinion, should have been given to^** 
^t this year, * « 



Ii)dicate your answers by circling the appropriate numbers opposite ' " 
/6ach issue; (Circle one i^umber in each rojtf) 

A great v ' Little 

* ^ * deal of ^ .'^ 4 Not or 

emphasis Moderate Some much none 



(a) Emphasis on skills, know- 
ledge and techniques for 
the practice of a future 
job 

Has _ . . , 

Should have ... 
ft * 

(b) Developments of self- 
awareness artd self- 
confidence and an undqr-- 
standing jpf. other peoplTb 

Has 

^ Should have .\ . 

(c) Development of attitudes 
which will assist students 
to settle into a job 

Has 

Should have . . 

(d) The ability to read, 
and use numbers 

Has 

Should hayo . . 

(e) Learning about our 
-society 

Has 

Should have , i 



-4 
% 



4 
4 



v 1 



write 



2 
2 



3 

3 



3 
3 



3 
3 



/ 4 



4 



5 



5 
5 



196 



. OniER ISSUES 

In your opinion,* how auch exemption fr«^ the term of an apprentice- 
jship should be given to a student who has cospleted 

(i) the 36 we4k pre-e»ploy^ent course? 

^^o credit 4-...^ ^ 

6 Bonths ; 2 

12 months' ^ ... •.^ ........... 3 

0 

18 months ...L 4 ' 

/21 nonths ^ 5 

24 months- 6 

More than two years < 7 

(ii) the^ 54 week pre-employment course? 

No credit 1 ' 

6 aonths / s . . . 2 

12 months r. , 3 ^ 

18 months 4 

21 months " - ^ 

24 months jiP'* " ^ * ^ 

More th^ two years ..7 ^ - ^ 

Please record my\ other cossaents which you think appropriate. 



Thank you for your help- 
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B4 The FoUoiif*4jp (juestionnaire 



AlBTRALIAN piKCIl FOR EDUCATICNAt RESEARCH 
PRE VDCATIQKAL EIXKL\TION PROJECT 



> ' Follov-up Qiy?stionnaxre ^ 

Last year you applied for a place in a full-time Technical College -course. 
This questionnaire is part of a reiearch project concerned witl? courses in 
Technical Colleges* . ' > , • . * • . 

In this questionnaire we would like you to answer soae questions about 
what you have done this year, ' 

Please answer these questions/within the next few days and send the 
questionnaire back to- us in the envelope supplied* 

All tKe infonaation you prpvide will be kept CONFII^TIAL - Only the staff 
working on thtf project will see, it. There 'is no need tci record yCur natfe 
on the quos4;ionnaire. 

For aost questions you wi>l need to draw a circle around the nuai>er next 
to the answer you choose. For a few questions you will need to .write yow 
answer in the> space provided below the question. 

1 (a) Which' of these best describes your present oc;:upation? • 

Working full-ti^ in a peraaanent job .-•••^ 1 

Working full-tixae in a teiq)orary job 2 

Working part-tiae 3 

*> 

Working and* training as an apprentice 4 

Not employed, looking for work 5 

Not empjioyed, not looking for work ./ ........6 

* - Home duties 7 

Full-tiiae study' ^ .,.8 

Other (describe ^ . . ^9* 

. ) 

h — • ^ 

(b) If you are working at present, could you describe your job? 

Please be as.. specific as ^ssihle j;e . g. receptionist in a dental 
surgery, apprentice carpenter, postraan) , but-theie is no need to 
^' , ♦ tell us the firm you work for. ^ 



If you are unemployedT, how long is it since you las't had a-full-tiise job? 

' Less than 1_ i^nth ] 

Between J_ and 3^ months .' 2 

• Between _3 and 6^ months ^ . . . ? 

* More, than 6 months \ , , 4 

Does not apply 5 



3 I£ you were to add together ftll the tiae that you h&vQ been unea^loyed 
since leaviiig sch^li, how many »onth* jifould that be? 

Does not appjy I ' 

A total of less than 1 aonth > . • ,2 

k total of between 1^ and 2 SKsnth? , 3 

A total of between ^ 6 aonths i ,4 

A total of Bore than 6 aonths ' , , .5 

4 ^How aany jobs have you had th\s year? 

One jol^ , . . , 1 

Two j£*s r , 2 

Threfe jobs ; 3 

More than three jobs \\ ... . . 4 

^ • No jobs n-.....^. ...5 

Does not apply, I have been a ^student all-year 6 

5 Mf you are stuc^ing full-tiae at present what sort of institution are 

you jattending? 

Does ndt apply .\ : 1 

Govemaent High School , , 2 

Non-Government School \ • , • ^5 

Technical College ; 4 

^ University- or College of Advanced Education 5 

^ Other (please specify ....6 

\ ) 

6 If you have been a full-time student for only part of the year please 
* , indicate 

V 

(a) t1\e period of tiiae FROM ; ' (Month) 

, TO (Month) 

* and ** • 

(b) - the sort of institution you attended (e.g. High School) 



Thank you for your *help. 
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B5 SwpLe letters 



The Au stralian CJoundf for EdQcatksnal 




Limited 




Dear Foxwer Stiident , - ^ 

The Australian Council for Educational Research is conducting ;a research study 
of some courses conducted^ in Technical Colleges. One of the courses in wkich 
we are interested is the course at i 

Technical College. As you were a student is that course last year we would 
be grateful if you could provide us w^ith sorc infonnation about the work you 
have done siixce finishing the course, 

I^t"-WQuld help us greatly if you could complete the attached questionnaire and 
return it to us in the envelope suppdie^ . 

All' the information you provide will be kept .CONFIDENTIAL. You will notice 
that your name, is not to be regarded anywhere on the questionnaire , \ 

The results which we oblain frod thjs questionnaires will help us make recom- 
mendations about the improvement of courses similar to the dne which you 
studied. It is important that ail the questionnaires are returned to us 
promptly, • ' ' 

/ . ' ■ 

Wa> would appreciate your completing and posting the quest iojriQaire as soon as 



possible . 



Yours fincerely, 

John Ainley 

Chitef Research Officer 



Enc, 
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APPENDIX C 
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ADDITIOiAL RESULTS CC^iCERNlNG THE ANALYsts OF SCALES 
USED IN THE STUDENT, CAREER AND TEACHER QUESTIONNAIRES 



\ 

\ 



CI Occupational Levels of Fathers of P^-Vocational Students 

C2 You and Your Work:, Principal Component and Reliability Analysis '~J^ 

C3 Teaching Metl^s and Work: Principal Coaponentis Aj^ysis 

C4 Teaching Methods and Work: It^^ Performance * 

C5 Teaching Methods and Work: ^ctpr Analysis 

C6 Prafc^tical Eaphasis: Item Performance * 

C7 Complaints Scale: ItieiB Performance 

C^ The* Cooper smith Self-fisteem Inventory: Summary Statistics 

C9 Career Maturity Inventory-Attitude Scale: Principal Components 

Analysis . • 

CIO Career Maturity Inventory-Attitude Scale: Factor Analysis ' 

4 

Cil The Need for Self -Development ScaJ,e: &immary Statistics 

C12 Ctecapational Futures: Computer Program 

C13 Retrospective Sati^f^ct^on: Some-Results " . ^ 
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Ttbl^ CI Ctacupational Levels of Fathers of Students Xv Four 
Pre-Voc&tional PxograMs 







Occupational LeVel 

; r- ^ . ^ 


* 


i 


Per C^t 

• * 


■ ^ 

1 ■ 


1 


Upper Professional 


12 




V ■ 


2 


Grafiers / 


2 - 








3 


Lower., Profession^al 




• 


0.4 ' 




4, 


Managerial 


47 




1 1 Q 




5 


Self'-Qaployed Shopkeepers 










. 6 


Other Faraiers 


15 ^ 




X ft 




7 


Clerical 


51 








8 


krvL&d Services and Police 


o 






/ 


9 


Craftsmen and Foremen 


115 




* • ■ 




10 


Shop Assistants 7 


c 




IX • 




11 


Process Itorkers and OITerators 


is . 


f 


«• 

4.1 




i 

12 


Drivers 


* 23 




* 5.9 V , . 




13 


Personal, Domestic and Other Services 


43 




11.0 




14 


Miners , 


1 




0.3 • 




15 


Faxm aiKl Rural Workers 






.1.3^ • 




16 


^ Labourers * 


19 




4.8 ' 






• 

Total Classified , , ' 


392 ■ , 




> ' « k 

t Art f\ ^ 






Not Classified 


36 


, ) 


■ 1 




Note: 


•■ - ■ . / 

Classified on the six point scale the distribution of all 


m ■ 

those 






occupations classified would be: 












_ ^ 

Category 


Per 


"a 

cent , 








1 Professional ^ 


10 


<I0) • 








2 ^^anagerral ^ 


^ 18 


(18) 








5 Clerical and Service 


15 > 


(16) 


> 



4 Skilled ' . . 2^ (29) 

S? Semi -Ski lied * ^ n 

6 Unskilled * .17 (16) 



a 

^ Percentages in parentheses refer to 370 fuH-tin^ students only. Other " 

percentages incltKie 22 part-tim^ students in the Chemistry Certificate program^ 
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Tabte C2 You and Your Work: Principalis Coiyonent and Reliability Analysis 



Ite» (Brief version)' 



College 



Work 
I tea-Total 



School 
Ites-Totsl 



^ sge 

ist l?rincipal 1 tea-Total 
Component Correlation Correlation Correlation ^ 
Loading 



Respojisible 


.6& 


• .49 


.44 


'* .35 


Worthwhile jobs 4md 
activities 


. 73 


, .55 


.41 


.48 


Deciding how the job 
should be done 


.60 , 


• 

' .-43 


.40 


\ .49 ' 


Treated as an add It 


,68 


.51 


.47 \ 


. 53 - 


Up-to-date equipment 


.66' 


-.47 


.45. 


.48 


Part of a teaii 


.69 


.53 


* .46 ' 


T44 


Reliability 


. 76^ . . 


.76V 




.73^. 


Percent of Variance 


45.6 








Eigenvalue - Gpmponent 1 


2.74 








- Component '2 


.89 




* 





^ Calculate^d fro© ^^r'H 
^ n(l-A) 

^ Cronbach's alpha coefficient 



^9 ' ' 

"S^le C3 Teaching Methods and Work: Principal Co mponents Analysis 



' Component 



1 

2 
3 

4 



( 



Eigenvalue 



. 6.11 
■ 1.62 
1.43 
,1.1. 



Total Vafiance 
Explained (%) - 

29.1, 
7.7 
6.8 
5.4 



Total 



N = 449 




10.30 



49. 1 
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Table C4 ' Teachgng Methods and Work: Item Performance 



:em \ 

t 



1st PrifKipal Xltet-^otal 
loading Coefficient 



H«an 



Standard 
Devutii^ 



I Uses everyday practical exai^les of 
topics discussed 


.42 




.35 


, 3.73 




.94 


2 Provides some ^ork for students - 
which^ is siiftilar to what they would 
do wTfen they finish the couirse 


.52 




.43 


3.89 




.96 • 


•3 Sets tasks which are useful and 
satisfying 


.64 




.56 


3.67 


1 


.02 


4 Discusses the refevance of topics 
for our society 






• 

.48 


3,32 


1 


.09 


5 Disctssses the usefulness^ and relevancy 
of eaclf^topic for later work 


• ,58 




.50 


3.80 




f 

.96. 


6 States clearly the purpose of each 
piece of wt>rk 


.65 




.55 


5.61 


1, 


.'16 


7 Explains things clearly at* the 
. studSTffts level 


,69 




.61 


3.61 


1, 


.16 


8 Enables you to work at your own pace 


.48 




.43 


5.24 


1, 


.26 


9 Gives enough tiae to coii5)lete a job 


.44 




.37 


3.3S 


1, 


..19 


10 Sets deadlines for work to be completed 


.06 


.06 


3.58 


1, 


.12 


11 Actively involves students in lessons 


.68 




.59 


3.34 


1-, 


.12 


12 Has motivated you to do your best \/brk - 


.67 




.60* 


3.43 


r, 


.15 


13 Treats students as adults 


.59 




.50 


3,45 


1, 


.32 


14 Encourages students t^^be fesponsible 
for their actions 


.59 




.53 


' 3.91 


0, 




IS States cleaVly the standards which 
are expected of students 


.47 




.42 


3.97 


0, 


.89 


16 Provides a lot of information about 
your progress 


.59 




,53 


2.94 


1. 


,21 


17 Lets voii selpct tonir'<s r>*mK1#»mc 
and examples ' 


.44 




.39 


.2.34 


1. 


,00 


18 EncourWes students to co-operate 
with each other in jobs ' • 


.62 ■ 




^54 


3.54 


1. 


08 


19 Encourages students to think about 
their future life 


.60 




.54 


^ 3. 79 *- 


' k 


03 


20 Requires correct spelling and 

expression in writteiv work ^ 


.16 




. 15 


3.35 


. 1. 


1 

24 


21 Requires accurate calculations with 
nun&ers 


. 36 




.32 


4.^1? 




90 


Reliability 
Scale statistics 


.87- 




.86 


74.02 


11. 


82 



Reliabtjlty (alpha] if item 10 deleted 
N " 449 " ' 



,87 
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Table C5 Teaching Methods and Work:, Factor Analysis / 



Item 



»F1 



Variisax^Factor Loadings 



F4 



1 




34 - 




• 


/ « 


2 

• 3-. 




54 

60. 


i . 






. .4 




' - 




• 

'S5 




■ S ~ : 
/ 6^ 




• . 49" 




. ' '. 55' ■ 
• 45 












40 




. 8 . ; . 






73 > ' 




r 






\ • 


61- 






CIO) 




• 






11 








43 ^ . 




12 •' 


t 


46 


37 






13 






,'33, 


34 






- 










IS 




38'* 






30 


16 






• 35 


45 " 


* 


r 




$ 




■ 45 




18 




33 




49 




19 








42 




^0 










73 


21 




43- 








Eigenvalue ^ 


6.11 


- . 1.62 


1.43 


1.13. 



Percent VaTiance 29.1 



7.7 



6.8 



5.4 



Note: Decimal points* have baen omitted and Values less than 0,3 
H&ve not bedn recorded. 
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Tattle C6 ' Practical Ewphasis; I teg Perfoimnce 



Ittm 



'Itea--Total Mean Standard 
Correlation Deviation 



Students aw more interested in sjHScial 
^ic*) training than* a general* <*ducation 

'The ataosphere is practical anji useful 
things are emphasized * 

' Many sifijjects stress ^stract ideas 
rather than rea^ things ^ 

The courses here •iijclude siany really* 
practical stfcjects ♦ 

Mdst students are interested in their , 
future jo^s ' 

Many teachdrs stress the practical uses 
of their s|ifaject so that a student may 
appl)/^what he- has learned in a jcto 

Learning to work with others is 
•important here 



.06 


3.90 


.99 


.39 


/ 4.00* 


.77 


.07 


3.32 

» * 


1.^3 


.36 


3.93 


.J57 


.22 


4,23 


.SI 


.38 


4.06 


.84 


.31 


4.20 


.84 




'27.65 


3.07 



Scale Statistics 
Reliability (alpha) 
N - 475 



0-52 




Table C7 Complaints "Scale: Item Performance 



, Item 

I. 


Item-Total 
Correlation 


Mean 


Standard 
Deviation 


' ~ — ^ 

General work pressure is too gr^at 


.44 


2.71 


1. 15 


There is not enough time for study 


.35 , 


2.63 


1.23 


There are too many hours in class 


.36 


2,78 


1.22 


There is too much emphasis on vocational 
training 


.46 


2,53 


1.01 


Course demands too much mechanical 
learning and opt much individual thinking. 


.43 


2.44 


1.08 


Too much like sedondary school 


.40 , 


2. 19 


1.24 


Scale Statistics 




15.28 


4. 30 


Reliability (alpha) = 0.68 








N = 473 * ^' 


f , 


< 


1 



2O0 
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** 


% 


Tabje C8, The Qoopersadt'h Self-Esteea Aiventor^ 
for Ite» Performance ^ 


"I 

Suasiary Statistics 

• T 

' i 




V; ' 

Itco Direction 


Mean It^ Scores v 


' y Ites-Total 
Correlations * 


Category Frequency 


Range Frequency 1 


Range Frequency 




0.00-0.20 0 " 


* - 

n riA-fi 1 n 






.0,21-0,40 2 
0,41-0-6Q ' 9 


,0.11-0. 2d^ 

# 

O'.21-0.3O/ 


•2 

» 

7 




0,61-0,80 13 


0.31-0.40 


12 


^ 


0/81-1.00 


. > 0.41 ■' 


2 , " 


Nusber of it ess « 25 


' ?; — 






Jleliabiliiy (coefficient alpha) -0.76 






Scale Mean « 15. OS- (items 


scored as 0 oril) 






Scale standard* deviation > 


4,65 







Nuaber of subjects ' 175 
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Table C9 farcer ffat^rity Inventory-^Attitude Seale; Princj^pal Coarpont^rits 
- Analysis ' ~ ^ ^ * ' 



Cowpojiant 



Eigenvalue 



Percent VariaJice Explained, 



1 


-„, ■ 


5, d7 






13* 1 




* 


It 

t • 


4 . 14 

• * ' ' * 2 , 44 

2,32 ' 


> 




8.3 r 

(1 ' * 

4. '9 

4: 7 V 








1.94 


> 




3.9, • 




O 




1,83' 






' 3.7 4*^ 




7 




1.59 " 

t .*•■'■ 






• ■■ > • 

■3. 2 ', -y/ • . 


» 


< -ft 


• 


1.51 






3>0 ^ / 




CI * 




1.46 










1 A 

12 


• * 


1.43 

' i.4i 

1. 31 - 






2.9 

/ 2 6 




13 




• 1.23 






. / 2.5 ■ • 








•1.19 






/ ■ 2.4 




15 


* 


1.14 






2.3 




16 




' 1,06 






2.1 




17 

* 




1.04 


V 




■ 2.1 




Total 










— 7— t 

- 67.3 





N - 165 



\ 
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«< 
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TaijJe CIO Career Maturity Inventoi^-Attitude Scaie; FactoV Analy sis 



Itea 


lF2 F3 


^ Item 


^ 


Factor Loading 




FX 




1 


.j41 


?6 


it 

49 




.2- . 




, - 27 




• 36 


• 3 ■ 




28, 




39 ■ 


' . .4 37 


• 


29 




t 


/ . 5 • - -46 ' ' 


*'r 30 




m- 4 




J . 28 


31 , 


* 




7 • 


31 


32 






8 

' , 9 


% 

: . , ' 25 


^ 33 , 
^ 34 


''a 


35 


.10 




35 






11 




* . r 36 ' ' ' 


38 




12 


3% 


37 * 


32 




13 


-36 45 


38 




* 


14 


, -41 44 


' i 39 






15 ^ 


69 


40 






16 40 


2^ 


41 




69 


17 56 




42 


t 


47 


18 51 




43 


S2 


• 

55 


32 


35 


44 


•45 


62 


20 27 




45 


ft 




< 21 




46 






^ 22 


35 


47 




54 


23 - 42 




48 


41 


58 


24 40 


28 


49 


. 33 


48 


25 




50 

— ^ { 




61 . 


Eigenvalue 


,4 




""T ■ 

6.57 


4*14 2.44 


Percent Variance 




4 

13.1 


8,3 4,9 



Note: Factor Loadings less than 0.25 have not been recorded and decimal 
points nave been ozaitted 
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^Tl^ft Cll The Nqed for ^el^evelopwent Scale 



... j 



. Mean J^fsm 
Scores ^ 

/feange . . Frequency 



Ite» . 
Standard Deviations 



Range 



Frequency 

■ T„ ■ \ — L 





' 1.0-2,0 


0 ' . 


< 0.9 


3 




2.1-3.0 


0 


0.9-1.0 


4 


•' / 


3. '1-4.0 




1.0-i.r 


. 4 * 












/ - . 


4.1-'S.O ■ 


3 


> 1.1 


4 



Nuffiber of itess « IS 
Reliability (coe££i,cient alpha) 
Scale aean « 55.97 . 
Scale standard deviation * S«52 



0.8 





I toe-Total 
Correlations 

,|Ftequ«acy 

it 

1 " 
I 

i 

3. 
9 



it 



2QA 
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Table ei2 Computing Consj^tenQy Scores for the Future 4 
Possibilities QuestioTi " ^ 

According to Holland/ (1973) occupations can be classified into six broad 
categories: /realistic; investigative,^ artistic, social; enterprising and 
convent ionan To represent the similar it^ 6f these occupations Itoiland has 
proposed a hexagonal diagraa ^s well as a detailed classification of many 
jobs, Holland's hexagonal laodel with the coding categories used in the 
present study has been simply represented in Figure E12/1. 

As discussed in Chipter Six this ©odel provided a structure for exaisinijig 
student career choice in the Melbourne Careers* Project following an approach 
developed at the Johns Hopkins University , Baltiioore, In that project 
students' future possible .occupations were scored according to 'how closely ^ 
they resembled vocational ^aspirations. Por the present project future 
^xjssibilities weye scored in relation to the congruence of those cYioices- with 
the fields to which the course of study was directed viz: 

Carpentry and Joinery and Polytechnical : Realistic 
Office Tivaining : Conventional 
Cheisistry Certificate : Investigative^' 

Future possibilities were first classified according to Hollarui's six \^ 
categories and then coded on computer. A procedure based on the SPSS system 
CNie, ejt al^. , 1975) was devised as part of the present project to generate 
for each student 

(a) proximity scores for each stated possibility, and 

(bj an average consistency score for the list of possibil ities .t 

The procedure also calculated the number of possibilities listed by each student 
An outline of the main steps in this procedure is provided below. It was ^ , 
used in conjunction with the Statistical Package for the Social Sciences 

' / ' 
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Table C12 (coatimaed) 
' (Nie et al^,, 1975) but cdtild be apislied to other packages. 



.1 The data on e^ph of the 10 Variables representing the listed' 
possibiiities, a^s coded into%HoHand*s six categories was read. 

Scores were calculated wh4ch ii^icated the/proximity of each choice 
to the cJassification appropriate to the ctxxrse of study. In this 
project the cmirses came froa three classificati-ons and th-is resulted 

30 new variables. The DO REPEAT and RKCM)^ programs «f the SPSS 
were used to perform this^task- Fo^^^example, to calculate proxiaity 
scores^ for office training the following recodings were required: 
6 to 4, S to 3, 1 to S, 4 ^o 2, and 3 to 1 . ^ 

3 ^ Th? total number of possibilities CN) listed by each respondent was 

calculated.. The COUNT procedure was used for this. . 
• ^1 

4. The sua 6f all the proximity scores for each respondent was calculated 

using a sujmaation procedure which terminated when the number of 

^ possibilities listed. was exhausted. Three totals^ere calculated 

(TOFE, TREAi TINV) in the present project. 

5 The average scoi^es were calculated by dividing the sum of the p^^^imity 
scores by the number of possibilities. 




^ REFERENCES 
Hollard, J.I. 

1973 Making Vocational Choices: A Theory of Careers 

Englewood Cliffs, New Jersey: Prentice Hall. i *^ 

Nie, N.H. et al. \ . < 
1975 Stq^tistigil Package for the Social Sciences ^ 
New York: McGraw Hill . 
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Table C13 Retrospective Sati^^faction; SoAe Remits ' , ^ 

* . ■" . . - . .fi 1- .- - - - _ . -- - ' ^ 



It^-Tdtal 
Correlation 



Standard 
Deviation 



1 The skills, knowledge and 
techniques in my job 

^ 2 Self-awareness 'and self- ^ 1 
conj^dence and understanding 
otnS.p^]Ple 

3 AtTT^ides in settling into a 
^ ^ 'job 

4 Basic fiiTcills of reading, 

writing and calculation ^ 

5 General knowledge of. society 

6 Experience of what work is 

like 

7 Knowing how to obtain* a job 

8 Experience of working under 

pressure ^ 



O-SS 

;).58 

0.54- 

0,61 
0.59 



3.92 
3.80, 

3.84 

3.92 

3.54 
3.84 



0.54 4 . 05 

0.60 3,^3 



0.99 
0.9^ • 




Scale 



Note: 1 = very well 
5 = very poor 



alpha =0.83 



30.24 



5.34 



f. 
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